Systems and methods for spectral imaging with compensation functions

ABSTRACT

Provided are systems and methods for imaging with compensation functions. An imaging device comprises a plurality of light source sets, of which two or more light source sets emit light of a same specific spectral range to compensate intensity differences among different spectral ranges. The imaging device can be integrated with a mobile device. A method comprises a subtraction procedure to compensate ambient light effect, a normalization procedure to compensate incidence angle effect, a 3D reconstruction procedure to compensate distance effect, or any combination of these procedures. The method is performed at an imaging device comprising a controller. At least one program is non-transiently stored in the controller and executable by the controller.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application is a continuation-in-part application of U.S.patent application Ser. No. 15/867,653 filed Jan. 10, 2018, now issuedas U.S. Pat. No. 10,554,909, which claims priority to U.S. ProvisionalPatent Application No. 62/444,731, filed Jan. 10, 2017, entitled“Hyperspectral Transmitter,” which are hereby incorporated by referencein their entirety.

BACKGROUND Field

The present disclosure relates to an imaging device. More particularly,the present disclosure relates to systems and method for imaging using aplurality of light sources.

Description of Related Art

In general, hyperspectral imaging is an imaging technique thatintegrates multiple images of a subject or region of interest resolvedat various spectral bands into a single image, known as ahyperspectral/multispectral image. Each image of the multiple imagesrepresents a narrow spectral band acquired over a continuous spectralrange. For example, a hyperspectral/multispectral imaging system mayacquire at least two images, with each image taken using a differentspectral band. The multiple images of the subject or region or interestcan for example be sequentially captured and processed to generate thedesired hyperspectral image. For the multiple images to be useful ingenerating a high quality hyperspectral image, however, the multipleimages must be similar in composition and orientation. For instance, thesubject or region of interest of the multiple images must be positionednearly identical in each frame to allow for seamless combination.

Hyperspectral imaging devices have been utilized in various industries,from geological and agricultural surveying to medical diagnosis. Withinthe medical field, hyperspectral imaging has been utilized to facilitatecomplex diagnosis and predict or analyze treatment outcomes. Other suchuses of a hyperspectral imaging device include material compositionanalysis, biometrics and the like.

Despite the enormous potential for hyperspectral imaging and devicesthereof, there exists numerous hurdles that prevent such devices frombeing universally implemented. Conventional hyperspectral imagingdevices utilize high-end optics and expensive hardware, yielding anexceptionally high manufacturing cost. These devices are often large andbulky, requiring significant weight and/or size.

Prior hyperspectral imaging devices typically reduce the total energy ofa given system by applying a plurality of filters to a given signal.Such systems require light having a high intensity to ensure suitabletransmission quality through the filter, which often consumes a largeamount of power.

Additionally, since the component images are captured sequentially,ensuring that all of the component images are properly aligned can bedifficult. This is especially true in the medical and military industrywhere a clinician or responder is capturing images of a subject orregion of interest that may move, or who may be positioned in a way thatmakes capturing images of the subject or region of interest difficult.

Thus, prior to the present disclosure there existed a need for ahyperspectral imaging device that greatly reduces time required tocapture hyperspectral images at significantly reduced costs.

The information disclosed in this Background of the Invention section isonly for enhancement of understanding of the general background of theinvention and should not be taken as an acknowledgement or any form ofsuggestion that this information forms the prior art already known to aperson skilled in the art.

BRIEF SUMMARY

Advantageously, the hyperspectral/multispectral imaging device detailedin the present disclosure address the shortcomings in the prior artdetailed above.

Various aspects of the present disclosure are directed to providing ahyperspectral/multispectral imaging device, non-transitory computercomprising at least one executable program, and a method thereof.

Device Embodiments

One aspect of the present disclosure provides an imaging devicecomprising a housing having an exterior and an interior. The imagingdevice also includes an objective lens within the housing which is flushwith a surface of the housing. Thus, the objective lens does notsubstantially extend past the surface of the housing. A plurality oflight source sets is attached or integrated into the housing. Eachrespective light source set in the plurality of light sources setscomprises a plurality of lights that is uniformly radially distributedabout the objective lens. A first light source set in the plurality oflight source sets emits light that is substantially limited to a firstspectral range, and a second light source set in the plurality of lightsource sets emits light that is substantially limited to a secondspectral range other than the first spectral range. A singletwo-dimensional pixelated detector is disposed within the housing and inoptical communication with the objective lens. The imaging deviceincludes a controller, comprising at least one program non-transientlystored in the controller and executable by the controller. The at leastone program causes the controller to perform a method of i) concurrentlyfiring the plurality of lights in the first light source set for a firsttime period while not firing any other light source set in the pluralityof light source sets, ii) collecting light from the objective lensduring all or a portion of the first time period using thetwo-dimensional pixelated detector, iii) concurrently firing theplurality of lights in the second light source set for a second timeperiod while not firing any other light source set in the plurality oflight source sets, and iv) collecting light from the objective lensduring all or a portion of the second time period using thetwo-dimensional pixelated detector, thereby forming at least one digitalimage.

In some embodiments, a single digital image is formed from a combinationof the collecting ii) and the collecting iv).

In some embodiments, a first digital image is formed from the collectingii) and a second digital image is formed from the collecting vi).

In some embodiments, the uniform radial distribution forms at least oneconcentric circle about the objective lens.

In some embodiments, each light source set in the plurality of lightsource sets consist of n light sources, where n is a positive integergreater than or equal to two. Each light source of a respective lightsource set is arranged with θ degrees of separation to another lightsource of the respective light source set, where

$\theta_{1} = {\frac{360}{n}.}$

In some embodiments, a respective light source of each respective lightsource set is disposed at a same location.

In various embodiments, each light source of the respective light sourceset in the plurality of light source sets is arranged with θ₂ degrees ofseparation from an adjacent light source of a different light source setin the plurality of light source sets, wherein

$\theta_{2} = \frac{360}{kn}$

and k is a number of light source sets.

In some embodiments, a wavelength spectra of emitted light from theplurality of light source sets is substantially limited by a pluralityof optical filters. Each light source in the first light source set isfiltered by a different bandpass filter in a first plurality of bandpassfilters such that each bandpass filter in the first plurality ofbandpass filters limits light emission to the first spectral range. Eachlight source in the second light source set is filtered by a differentbandpass filter in a second plurality of bandpass filters such that eachbandpass filter in the second plurality of bandpass filters limits lightemission to the second spectral range.

In some embodiments, the plurality of optical filters comprises at leastone longpass filter. In some embodiments, the plurality of opticalfilters comprises at least one shortpass filter.

In some embodiments, the first spectral range is 405±10 nanometers (nm)to 890±10 nm and the second wavelength band is 405±10 nm to 890±10 nm.

In some embodiments, the plurality of light source sets emit light at anintensity of 500 micro-candela (mcd) to 1500 mcd.

In some embodiments, the first time period is between 2 ms and 100 ms,and the second time period is between 2 milliseconds (ms) and 100 ms.

In some embodiments, a third light source set in the plurality of lightsource sets emits light that is substantially limited to a thirdspectral range or wavelength.

In some embodiments, k light source sets in the plurality of lightsource sets emit light that is substantially limited to k spectralranges or wavelength(s).

In some embodiments, the objective lens is selected from the groupconsisting of a three dimensional (3D) binocular, a fiber optic, afisheye lens, a macro lens, a microscopic lens, a normal lens, and atelephoto lens.

In some embodiments, the two-dimensional pixelated detector is selectedfrom the group consisting of a charge-coupled device (CCD), acomplementary metal-oxide-semiconductor (CMOS), a photo-cell, and afocal plane array.

In specific embodiments, the housing snap-fits to a mobile device.

In some embodiments, the imaging device is flush with a surface of themobile device.

In various embodiments, the mobile device is selected from the groupconsisting of a smart phone, a personal digital assistant (PDA), anenterprise digital assistant, a tablet computer, and a digital camera.

Yet another aspect of the present disclosure provides a lighting deviceof an imaging device. The lighting device comprises a plurality of lightsource sets. Each respective light source set in the plurality of lightsource sets comprises a plurality of lighting components that isuniformly radially distributed about an objective lens of the imagingdevice. The plurality of light source sets comprises (i) two or morelight source sets, each emitting light that is substantially limited toa first spectral range; and (ii) one or more light source sets, eachemitting light that is substantially limited to a second spectral rangeother than the first spectral range.

In some embodiments, a collective lighting intensity produced by the twoor more light source sets that emit light substantially limited to thefirst spectral range and a collective lighting intensity produced by theone or more light source sets that emit light substantially limited tothe second spectral range are substantially the same.

In some embodiments, a collective lighting intensity produced by the twoor more light source sets that emit light substantially limited to thefirst spectral range is between 500 micro-candela to 1500 micro-candela.

In some embodiments, the first spectral range is 305 nanometers (nm)±10nm to 890 nm±10 nm and the second wavelength band is 305 nm±10 nm to 890nm±10 nm.

In some embodiments, the first spectral range is selected in accordancewith an absorption spectra of a first chromophore and the secondspectral range is selected in accordance with an absorption spectra of asecond chromophore.

In some embodiments, one of the first and second chromophores is melaninand the other of the first and second chromophores is hemoglobin.

In some embodiments, the lighting device further comprises: (iii) one ormore light source sets, each emitting light that is substantiallylimited to a third spectral range other than the first and secondspectral ranges.

In some embodiments, each light source set in the plurality of lightsource sets consists of n lighting components, wherein n is a positiveinteger of value two or greater, and each lighting component of arespective light source set is arranged with θ₁ degrees of separation toanother lighting component of the respective light source set, wherein

$\theta_{1} = {\frac{360}{n}.}$

Still another aspect of the present disclosure provides an imagingdevice comprising: (A) a housing, (B) an objective lens, C) J lightsource sets, (D) a detector, and E) a controller. The housing has anexterior and an interior. The objective lens is disposed within thehousing and flush with a surface of the housing so that the objectivelens does not substantially extend past the surface of the housing. TheJ light source sets are attached or integrated into the housing. J is apositive integer of three or greater, and K is a positive integersmaller than J. Each spectral range is different than any other spectralrange in the K spectral ranges. For each respective k^(th) spectralrange in the K spectral ranges, the J light source sets comprisecorresponding j_(k) light source set or sets, wherein j_(k) is apositive integer of one or greater, and Σ_(k=1) ^(K)j_(k)=J. Eachrespective light source set in the J light source sets comprises aplurality of lighting components that is uniformly radially distributedabout the objective lens. The detector is disposed within the housingand in optical communication with the objective lens. At least oneprogram is non-transiently stored in the controller and executable bythe controller. When executed, the at least one program causes thecontroller to control operation of the plurality of light source setsand the detector.

In some embodiments, the detector is a single two-dimensional pixelateddetector.

In some embodiments, the at least one program causing the controller toperform a method of: for each integer k∈{1, . . . , K}, (A) concurrentlyfiring lighting components of the j_(k) light source set or sets in theJ light source sets for a k^(th) predetermined time period; and (B)collecting, using the detector, light during all or a portion of thek^(th) predetermined time period, thereby forming at least one digitalimage.

In some embodiments, two or more light source sets in the J light sourcesets emit light that is substantially limited to a first spectral range,and one or more light source sets in the J light source sets emit lightthat is substantially limited to a second spectral range other than thefirst spectral range.

In some embodiments, a collective lighting intensity produced by the twoor more light source sets that emit light substantially limited to thefirst spectral range and a collective lighting intensity produced by theone or more light source sets that emit light substantially limited tothe second spectral range are substantially the same.

In some embodiments, a collective lighting intensity produced by the twoor more light source sets that emit light substantially limited to thefirst spectral range is between 500 micro-candela to 1500 micro-candela.

In some embodiments, the first spectral range is 305 nanometers (nm)±10nm to 890 nm±10 nm and the second wavelength band is 305 nm±10 nm to 890nm±10 nm.

In some embodiments, the first spectral range is selected in accordancewith an absorption spectra of a first chromophore and the secondspectral range is selected in accordance with an absorption spectra of asecond chromophore.

In some embodiments, one of the first and second chromophores is melaninand the other of the first and second chromophores is hemoglobin.

In some embodiments, each light source set in the J light source setsconsists of n lighting components, wherein n is a positive integer ofvalue two or greater, and each lighting component of a respective lightsource set is arranged with θ₁ degrees of separation to another lightingcomponent of the respective light source set, wherein

$\theta_{1} = {\frac{360}{n}.}$

In some embodiments, one or more light source sets in the J light sourcesets emit light that is substantially limited to a third spectral rangeother than the first and second spectral ranges.

In some embodiments, a collective lighting intensity produced by the twoor more light source sets that emit light substantially limited to thefirst spectral range, a collective lighting intensity produced by theone or more light source sets that emit light substantially limited tothe second spectral range, and a collective lighting intensity producedby the one or more light source sets that emit light substantiallylimited to the third spectral range are substantially the same.

In some embodiments, the at least one program causing the controller toperform a method of: (i) concurrently firing the two or more lightsource sets that emit light substantially limited to the first spectralrange while not firing any other light source set in the J light sourcesets; (ii) collecting light from the objective lens over a first timeperiod using the detector; (iii) concurrently firing the one or morelight source sets that emit light substantially limited to the secondspectral range while not firing any other light source set in the Jlight source sets; and (iv) collecting light from the objective lensover a second time period using the detector, thereby forming at leastone digital image.

Yet another aspect of the present disclosure provides a lighting deviceof an imaging device. The lighting device comprises J light source setsfor emitting light of N spectral ranges. J is a positive integer ofthree or greater and K is a positive integer smaller than J. Eachspectral range is different than any other spectral range in the Kspectral ranges. For each respective k^(th) spectral range in the Kspectral ranges, the J light source sets comprise corresponding j_(k)light source set or sets, wherein j_(k) is a positive integer of one orgreater, and Σ_(k=1) ^(K)j_(k)=J. Each respective light source set inthe J light source sets comprises a plurality of lighting componentsconfigured to be uniformly radially distributed about an objective lensof the imaging device.

In some embodiments, two or more light source sets in the J light sourcesets emit light that is substantially limited to a first spectral range;and one or more light source sets in the J light source sets emit lightthat is substantially limited to a second spectral range other than thefirst spectral range.

In some embodiments, a collective lighting intensity produced by the twoor more light source sets that emit light substantially limited to thefirst spectral range and a collective lighting intensity produced by theone or more light source sets that emit light substantially limited tothe second spectral range are substantially the same.

In some embodiments, a collective lighting intensity produced by the twoor more light source sets that emit light substantially limited to thefirst spectral range is between 500 micro-candela to 1500 micro-candela.

In some embodiments, the first spectral range is 305 nanometers (nm)±10nm to 890 nm±10 nm and the second wavelength band is 305 nm±10 nm to 890nm±10 nm.

In some embodiments, the first spectral range is selected in accordancewith an absorption spectra of a first chromophore and the secondspectral range is selected in accordance with an absorption spectra of asecond chromophore.

one of the first and second chromophores is melanin and the other of thefirst and second chromophores is hemoglobin.

In some embodiments, one or more light source sets in the J light sourcesets emit light that is substantially limited to a third spectral rangeother than the first and second spectral ranges.

In some embodiments, each light source set in the J light source setsconsists of n lighting components, wherein n is a positive integer ofvalue two or greater, and each lighting component of a respective lightsource set is arranged with θ₁ degrees of separation to another lightingcomponent of the respective light source set, wherein

$\theta_{1} = {\frac{360}{n}.}$

Non-Transitory Computer Readable Storage Medium Embodiments

Another aspect of the present disclosure provides a non-transitorycomputer readable storage medium comprising instructions for executionby one or more processors to perform a hyperspectral/multispectralimaging regimen using a mobile device comprising the one or moreprocessors, an objective lens, a two-dimensional pixelated detector inoptical communication with the objective lens, and i light source sets,the instructions comprising, for each integer i in the set {1, . . . , i, . . . , k}, wherein k is a positive integer of two or greater. Theinstructions include instructions for instructing an i^(th) plurality oflights uniformly radially distributed about the objective lens in thei^(th) light source set in the plurality of light source sets to firefor an i^(th) time period while not firing any other light source set inthe plurality of light source sets. The instructions further includeinstructions for instructing the two-dimensional pixelated detector tocollect light from the objective lens during all or a portion of thei^(th) time period, thereby forming at least one digital image.

In some embodiments, the non-transitory computer readable storage mediumincludes instructions for instructing a plurality of lights uniformlyradially distributed about the objective lens in a k^(th) light sourceset in the plurality of light source sets to fire for a predeterminedtime period while not firing any other light source set in the pluralityof light source sets. Further, the instructions include instructions forinstructing the two-dimensional pixelated detector to collect a k^(th)image during the predetermined time period, and combining at least thefirst through k^(th) images to form a hyperspectral/multispectral image.

The present disclosure also provides one or more non-transitory computerreadable storage mediums comprising instructions for imaging at animaging device including but not limited to the imaging devicesdisclosed herein. The instructions are non-transiently stored in acontroller, including but not limited to those disclosed herein, andexecutable by the controller. When executed, the instructions cause thecontroller to perform one or more methods, including but not limited tothose disclosed herein such as methods for removing ambient lightcontribution and compensating incidence angle and/or distance effect.

Method Embodiments

Another aspect of the present disclosure provides a method forperforming a hyperspectral/multispectral imaging regimen at a mobiledevice comprising one or more processors, memory storing one or moreprograms for execution by the one or more processors, an objective lens,a controller, a two-dimensional pixelated detector in opticalcommunication with the objective lens, and a plurality of light sourcesets, attached to or integrated with the mobile device, comprising afirst light source set in the plurality of light source sets and asecond light source set in the plurality of light source sets. The oneor more programs singularly or collectively instruct, through thecontroller, the first light source set in the plurality of light sourcesets to fire for a first time period. The one or more programs furtherinstruct, through the controller, the two-dimensional pixelated detectorto acquire a first image during the first time period. The one or moreprograms further instruct, through the controller, the second lightsource set in the plurality of light source sets to fire for a secondtime period. The one or more programs further instruct, through thecontroller, the two-dimensional pixelated detector to acquire a secondimage during the second time period. The one or more programs furthercombine at least the first image and the second image to form ahyperspectral/multispectral image.

In some embodiments, the second instance of instructing occursconcurrently with the first instance of instructing for a time periodequal to the first time period plus the second time period, the thirdinstance of instructing occurs subsequent completion of the firstinstructing, and the fourth instance of instructing is omitted.

In some embodiments, one or more programs instruct, through thecontroller, a k^(th) light source set in the plurality of light sourcesets to fire for a predetermined time period, and instruct, through thecontroller, the two-dimensional pixelated detector to collect a k^(th)image during the predetermined time period, and combining at least thefirst through k^(th) images to form a hyperspectral/multispectral image.

Another aspect of the present disclosure provides a method forhyperspectral/multispectral imaging. The method is performed at animaging device comprising a detector, a controller, and J light sourcesets for emitting light of K spectral ranges. J is a positive integer ofthree or greater and K is a positive integer smaller than J. Eachspectral range is different than any other spectral range in the Kspectral ranges. For each respective k^(th) spectral range in the Kspectral ranges, the J light source sets comprise corresponding j_(k)light source set or sets, wherein j_(k) is a positive integer of one orgreater, and Σ_(k=1) ^(K)j_(k)=J. At least one program isnon-transiently stored in the controller and executable by thecontroller, the at least one program causing the controller to performthe method of: for each integer k∈{1, . . . ,K}, (A) concurrently firinglighting components of the j_(k) light source set or sets in the J lightsource sets for a k^(th) predetermined time period; and (B) collecting,using the detector, light during all or a portion of the k^(th)predetermined time period, thereby forming at least one digital image.

In some embodiments, two or more light source sets in the J light sourcesets emit light that is substantially limited to a first spectral range,and one or more light source sets in the J light source sets emit lightthat is substantially limited to a second spectral range other than thefirst spectral range.

In some embodiments, one or more light source sets in the J light sourcesets emit light that is substantially limited to a third spectral rangeother than the first and second spectral ranges.

Yet another aspect of the present disclosure provides a method forremoving ambient light contribution. The method is performed at animaging device comprising one or more light source sets, a detector anda controller. At least one program is non-transiently stored in thecontroller and executable by the controller. When executed, the at leastone program causes the controller to perform the method comprising: (A)acquiring a reference image of a region of interest (ROI) by using thedetector to collect light over a reference time period while the ROI isnot exposed to any light emitted from the one or more light source sets,wherein the reference image comprises an array of pixels eachcorresponding to a sub-region in an array of sub-regions of the ROI; (B)firing a first light source set while not firing any other light sourceset in the one or more light source sets, wherein the first light sourceset in the one or more light source sets emits light that issubstantially limited to a first spectral range; (C) acquiring a firsttarget image of the ROI by using the detector to collect light over afirst time period while the ROI is exposed to the light emitted from thefirst light source set, wherein the first target image comprises anarray of pixels each corresponding to a sub-region in the array ofsub-regions of the ROI; and (D) compensating the first target image ofthe ROI using the reference image of the ROI, thereby generating a firstcompensated image of the ROI, wherein each respective pixel in the arrayof pixels of the first target image is compensated using thecorresponding pixel in the array of pixels of the reference image.

In some embodiments, each respective pixel in the array of pixels of thefirst target image is compensated by subtracting, from an intensityvalue at the respective pixel, an intensity value at the correspondingpixel in the array of pixels of the reference image multiplied by aratio of the first time period over the reference time period.

In some embodiments, the first time period is substantially the same asthe reference time period.

In some embodiments, the first time period is between 1 millisecond and100 milliseconds.

In some embodiments, the detector comprises a two-dimensional pixelateddetector.

In some embodiments, the imaging device further comprises an objectivelens in optical communication with the detector, wherein the first lightsource set in the one or more light source sets comprises a plurality oflighting components that is radially distributed about the objectivelens.

In some embodiments, the light emitted from each light source set in theone or more light source sets has an intensity higher than the lightfrom an ambient.

In some embodiments, the method further comprises: (E) co-registering,prior to the compensating (D), the reference image and the first targetimage of the ROI.

In some embodiments, the method further comprises: (F) firing a secondlight source set while not firing any other light source set in the oneor more light source sets, wherein the second light source set in theone or more light source sets emits light that is substantially limitedto a second spectral range, and the second spectral range that isdifferent than the first spectral range; (G) acquiring a second targetimage of the ROI by using the detector to collect light over a secondtime period while the ROI is exposed to the light emitted from thesecond light source set, wherein the second target image comprises anarray of pixels each corresponding to a sub-region in the array ofsub-regions of the ROI; and (H) compensating the second target image ofthe ROI using the reference image of the ROI, thereby generating asecond compensated image of the ROI, wherein each respective pixel inthe array of pixels of the second target image is compensated using thecorresponding pixel in the array of pixels of the reference image.

In some embodiments, each respective pixel in the array of pixels of thesecond target image is compensated by subtracting, from an intensityvalue at the respective pixel, an intensity value at the correspondingpixel in the array of pixels of the reference image multiplied by aratio of the second time period over the reference time period.

In some embodiments, the second time period is substantially the same asthe first time period or as the reference time period.

Further another aspect of the present disclosure provides another methodfor removing ambient light contribution. The method is performed at animage device comprising a detector, a controller, and J light sourcesets for emitting light of K spectral ranges, wherein each spectralrange is different than any other spectral range in the K spectralranges, wherein for each respective k^(th) spectral range in the Kspectral ranges, the J light source sets comprise corresponding j_(k)light source set or sets, wherein j_(k) is a positive integer of one orgreater, and Σ_(k=1) ^(K)j_(k)=J. At least one program isnon-transiently stored in the controller and executable by thecontroller. When executed, the at least one program causing thecontroller to perform the method comprising: (A) acquiring a referenceimage of a region of interest (ROI) by using the detector to collectlight over a reference time period while the ROI is not exposed to anylight emitted from the one or more light source sets, wherein thereference image comprises an array of pixels each corresponding to asub-region in an array of sub-regions of the ROI. For each integer k∈{1,. . . , K}, the method further comprises: concurrently firing lightingcomponents of the j_(k) light source set or sets in the J light sourcesets while not firing any other light source set in the J light sourcesets; (C) acquiring a respectively target image of the ROI by using thedetector to collect light over a respective k^(th) target time periodwhile the ROI is exposed to the light emitted from the j_(k) lightsource set or sets, wherein the respective target image comprises anarray of pixels each corresponding to a sub-region in the array ofsub-regions of the ROI; and (D) compensating the respective target imageof the ROI using the reference image of the ROI, thereby generating arespective compensated image of the ROI, wherein each respective pixelin the array of pixels of the respective target image is compensatedusing the corresponding pixel in the array of pixels of the referenceimage.

In some embodiments, each respective pixel in the array of pixels of therespective target image is compensated by subtracting, from an intensityvalue at the respective pixel, an intensity value at the correspondingpixel in the array of pixels of the reference image multiplied by aratio of the respective k^(th) target time period over the referencetime period.

In some embodiments, the method further comprises: (E) co-registering,prior to the compensating (D), the reference image and the respectivetarget image of the ROI.

In some embodiments, the method further comprises: (F) combining eachrespective compensated image of the ROI generated using each respectivelight source set in the plurality of light source sets into a singlehyperspectral/multispectral image.

In some embodiments, J is a positive integer of three or greater and Kis a positive integer smaller than J.

In some embodiments, two or more light source sets in the J light sourcesets emit light that is substantially limited to a first spectral range,and one or more light source sets in the J light source sets emit lightthat is substantially limited to a second spectral range other than thefirst spectral range.

In some embodiments, one or more light source sets in the J light sourcesets emit light that is substantially limited to a third spectral rangeother than the first and second spectral ranges.

Still another of the present disclosure provides a method forcompensating incidence angle and/or distance effects. The method isperformed at an imaging device comprising an objective lens, a lightsource adjacent to the objective lens, a detector in opticalcommunication with the objective lens, and a controller. At least oneprogram is non-transiently stored in the controller and executable bythe controller. When executed, the at least one program causes thecontroller to perform the method comprising: (A) acquiring a targetimage of a region of interest (ROI) by using the detector to collectlight over a target time period while the ROI is exposed to lightemitted from the light source set, wherein the target image comprises anarray of pixels each corresponding to a sub-region in an array ofsub-regions of the ROI; (B) creating a three-dimensional model for theROI using the target image of the ROI, wherein the three-dimensionalmodel comprises a plurality of points, each comprising three spatialcoordinates; (C) determining a relative distance of each respectivepoint in the plurality of points of the three-dimensional model withrespect to the objective lens or with respect to a pseudo flat surface;and (D) adjusting brightness levels of the three-dimensional model inaccordance with the determined relative distance of each respectivepoint in the plurality of points of the three-dimensional model.

In some embodiments, the method further comprises: (E) compensating,prior to the creating (B), the target image of the ROI using a referenceimage of the ROI, thereby generating a compensated image of the ROI,wherein the reference image of the ROI is acquired by using the detectorto collect light over a reference time period while the ROI is notexposed to any light emitted from the light source, wherein eachrespective pixel in an array of pixels of the target image iscompensated using the corresponding pixel in an array of pixels of thereference image, and wherein the creating (B) is performed on thecompensated target image. In an amendment, the method further comprises:(G) normalizing, subsequent the compensating (E) and prior to thecreating (B), the compensated target image of the ROI using a datasetcollected from a Lambertian surface, thereby producing a normalizedtarget image, wherein an intensity value of each respective pixel in thearray of pixels of the compensated target image is normalized by acorresponding intensity value in the dataset of the Lambertian surface,and wherein the creating (B) is performed on the normalized targetimage.

In some embodiments, the method further comprises: (F) normalizing,prior to the creating (B), the target image of the ROI using a datasetcollected from a Lambertian surface, thereby producing a normalizedtarget image, wherein an intensity value of each respective pixel in thearray of pixels of the target image is normalized by a correspondingintensity value in the dataset of the Lambertian surface, and whereinthe creating (B) is performed on the normalized target image.

In some embodiments, the dataset of the Lambertian surface is collectedwith the Lambertian surface positioned at a distance of between 0.5 feetand 3 feet from the objective lens.

In some embodiments, the light source comprises one or more light sourcesets, each light source set comprising a plurality of lightingcomponents that is radially distributed about the objective lens.

In some embodiments, the light source comprises J light source sets foremitting light of K spectral ranges, wherein each spectral range isdifferent than any other spectral range in the K spectral ranges; foreach respective k^(th) spectral range in the K spectral ranges, the Jlight source sets comprise corresponding j_(k) light source set or sets,wherein j_(k) is a positive integer of one or greater, and Σ_(k=1)^(K)j_(k)=J; and each light source set in the J light source setscomprises a plurality of lighting components that is radiallydistributed about the objective lens.

In some embodiments, J is a positive integer of three or greater and Kis a positive integer smaller than J.

In some embodiments, the three-dimensional model for the ROI is createdusing a volumetric Convolutional Neural Network that performs directionregression of a volumetric representation of the three-dimensional modelfrom the target image.

In some embodiments, the brightness levels of the three-dimensionalmodel are adjusted linearly in accordance with the relative distances.

In some embodiments, the brightness levels of the three-dimensionalmodel are adjusted based on intensity values at the pseudo flat surface.

In some embodiments, the brightness levels of the three-dimensionalmodel are adjusted to brightness values at the pseudo flat surface.

In some embodiments, the ROI is a face of a subject.

The lighting device, imaging device, method and non-transitory computerreadable storage medium of the present invention have other features andadvantages that will be apparent from, or are set forth in more detailin, the accompanying drawings, which are incorporated herein, and thefollowing Detailed Description, which together serve to explain certainprinciples of exemplary embodiments of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an isometric view of an imaging device according to anexemplary embodiment of the present disclosure;

FIG. 2 illustrates a mobile device associated with an imaging deviceaccording to an exemplary embodiment of the present disclosure;

FIG. 3 a front schematic view of an imaging device according to anexemplary embodiment of the present disclosure;

FIG. 4 is a front schematic view of an imaging device according toanother exemplary embodiment of the present disclosure;

FIG. 5 is a front schematic view of an imaging device according to yetanother exemplary embodiment of the present disclosure;

FIG. 6 is a side schematic view of an imaging device and a mobile deviceaccording to a further exemplary embodiment of the present disclosure;

FIG. 7 is an enlarged schematic view of a plurality of light source setsaccording to an exemplary embodiment of the present disclosure;

FIG. 8 is an enlarged schematic view of a plurality of light source setsaccording to another exemplary embodiment of the present disclosure;

FIG. 9 is a rear schematic view of an imaging device according to anexemplary embodiment of the present disclosure;

FIG. 10 collectively illustrates a flow chart of methods for imagingdiscrete wavelength bands using a device in accordance with anembodiment of the present disclosure, in which optional steps orembodiments are indicated by dashed boxes;

FIG. 11, FIG. 12, and FIG. 13 are illustrations of a user interface forat least one executable program according to an exemplary embodiment ofthe present disclosure; and

FIG. 14A, FIG. 14B, FIG. 14C, FIG. 14D, and FIG. 14E represent variousimages according to an exemplary embodiment of the present disclosure;

FIG. 15A illustrates a lighting device according to an exemplaryembodiment of the present disclosure;

FIG. 15B illustrates a lighting device according to another exemplaryembodiment of the present disclosure;

FIG. 15C illustrates an imaging device according to an exemplaryembodiment of the present disclosure;

FIG. 15D is a partially enlarged view of FIG. 15C;

FIG. 15E illustrates an imaging device according to another exemplaryembodiment of the present disclosure;

FIG. 15F is a partially enlarged view of FIG. 15E;

FIG. 16 illustrates a flow chart of methods for imaging in accordancewith an embodiment of the present disclosure, in which optional steps orembodiments are indicated by dashed boxes;

FIG. 17A, FIG. 17B, and FIG. 17C collectively illustrate a flow chart ofmethods for imaging in accordance with another embodiment of the presentdisclosure, in which optional steps or embodiments are indicated bydashed boxes;

FIG. 18A and FIG. 18B collectively illustrate a flow chart of methodsfor imaging in accordance with another embodiment of the presentdisclosure, in which optional steps or embodiments are indicated bydashed boxes; and

FIG. 19A, FIG. 19B, and FIG. 19C collectively illustrate a flow chart ofmethods for imaging in accordance with another embodiment of the presentdisclosure, in which optional steps or embodiments are indicated bydashed boxes.

It should be understood that the appended drawings are not necessarilyto scale, presenting a somewhat simplified representation of variousfeatures illustrative of the basic principles of the invention. Thespecific design features of the present invention as disclosed herein,including, for example, specific dimensions, orientations, locations,and shapes will be determined in part by the particular intendedapplication and use environment.

In the figures, reference numbers refer to the same or equivalent partsof the present invention throughout the several figures of the drawing.

DETAILED DESCRIPTION

Reference will now be made in detail to various embodiments of thepresent invention(s), examples of which are illustrated in theaccompanying drawings and described below. While the invention(s) willbe described in conjunction with exemplary embodiments, it will beunderstood that the present description is not intended to limit theinvention(s) to those exemplary embodiments. On the contrary, theinvention(s) is/are intended to cover not only the exemplaryembodiments, but also various alternatives, modifications, equivalentsand other embodiments, which may be included within the spirit and scopeof the invention as defined by the appended claims.

It will also be understood that, although the terms first, second, etc.may be used herein to describe various elements, these elements shouldnot be limited by these terms. These terms are only used to distinguishone element from another. For example, a first subject could be termed asecond subject, and, similarly, a second subject could be termed a firstsubject, without departing from the scope of the present disclosure. Thefirst subject and the second subject are both subjects, but they are notthe same subject. Furthermore, the terms “subject” and “user” are usedinterchangeably herein. Additionally, a first light source set could betermed a second light source set, and, similarly, a second light sourceset could be termed a first light source set, without departing from thescope of the present disclosure. The first light source set and thesecond light source set are both light source sets, but they are not thesame light source set.

As used herein, the term “if” may be construed to mean “when” or “upon”or “in response to determining” or “in response to detecting,” dependingon the context. Similarly, the phrase “if it is determined” or “if [astated condition or event] is detected” may be construed to mean “upondetermining” or “in response to determining” or “upon detecting [thestated condition or event]” or “in response to detecting [the statedcondition or event],” depending on the context.

Furthermore, when a reference number is given an “i^(th)” denotation,the reference number refers to a generic component, set, or embodiment.For instance, a light source set termed “light source set 110-i” refersto the i^(th) in a plurality of light source sets.

Various aspects of the present disclosure are directed to providing ahyperspectral/multispectral imaging device, a non-transitory computerreadable storage medium comprising instructions for one or more programsto operate the given device, and a method thereof.

An imaging device of the present disclosure can be utilized in aplurality of fields and industries. In one implementation, an imagingdevice can be utilized for medical and skin care purposes. These usescomprise cosmetic applications, skin health and management, sun damagemonitoring, acne progression and treatment effectiveness mapping,wrinkle management, treatment and topical application analysis, generaldermatology, vascular analysis, three dimensional imaging, and the like.Cases can vary from capturing regions of interest as small as tens orhundreds of microns such as pore, blood vessel, and wrinkle detection toregions of interest of approximately 500 cm² for uses such as facialthree dimensional mapping and imaging.

In another implementation, an imaging device of the present disclosurecan be utilized for agriculture science. Agriculture science comprisesnormalized difference vegetation index (NDVI) calculation and moreadvance vegetation indices. In some embodiments, the imaging devicecomprises visible and infrared light which can be polarized to reduceadverse lighting effects. Regions of interest in agriculture science andgeology cases can range from 1 m² or less such as an individual tree tohundreds of square meters such as a farm. In such large region ofinterest cases, an array of imaging devices can be utilized.

In another implementation, an imaging device of the present disclosurecan be utilized for military and security purposes. Military andsecurity purposes comprise biometrics such as border checkpointsecurity, facial alteration counter-measures, material absorption onskin, clothes, surfaces, and the like.

In one implementation, as described herein, ahyperspectral/multispectral imaging device, and method, is describedthat concurrently captures multiple images, wherein each image iscaptured in a predetermined spectral range.

In another implementation, as described herein, ahyperspectral/multispectral imaging device, and method, is describedthat captures an image in a predetermined time period and concurrentlyfires a plurality of light source sets during the predetermined timeperiod. The present method allows multiple discrete spectral ranges orwavelengths to be captured in a single image. Thus, a subject does notneed to maintain perfect alignment between the imaging device and asubject to capture a high quality hyperspectral image.

FIG. 1 illustrates an exemplary embodiment of ahyperspectral/multispectral imaging device 100, a housing 300 having anexterior and an interior, and a mobile device 400. In the presentembodiment, the housing 300 is attached to the mobile device 400. Insuch embodiments, the housing 300 typically snap-fits to the mobiledevice 400; however, the present disclosure is not limited thereto. Insome embodiments, the housing 300 is integrated, or embedded, with themobile device 400.

FIG. 2 provides a description of a mobile device 400 that can be usedwith the present disclosure. The mobile device 400 has one or moreprocessing units (CPU's) 402, peripherals interface 470, memorycontroller 468, a network or other communications interface 420, amemory 407 (e.g., random access memory), a user interface 406, the userinterface 406 including a display 408 and input 410 (e.g., keyboard,keypad, touch screen), an optional accelerometer 417, an optional GPS419, optional audio circuitry 472, an optional speaker 460, an optionalmicrophone 462, one or more optional intensity sensors 464 for detectingintensity of contacts on the device 102 (e.g., a touch-sensitive surfacesuch as a touch-sensitive display system 408 of the device 102),optional input/output (I/O) subsystem 466, one or more communicationbusses 412 for interconnecting the aforementioned components, and apower system 418 for powering the aforementioned components.

In some embodiments, the input 410 is a touch-sensitive display, such asa touch-sensitive surface. In some embodiments, the user interface 406includes one or more soft keyboard embodiments. The soft keyboardembodiments may include standard (QWERTY) and/or non-standardconfigurations of symbols on the displayed icons. In some embodiments,the mobile device 400 further comprises a display, and the methodfurther comprises displaying the first image on the display. In someembodiments, and the displayed image is enlargeable or reducible byhuman touch to the touch screen. In some embodiments, the display isconfigured for focusing an image of a surface of a subject acquired bythe two-dimensional pixelated detector.

Device 402 optionally includes, in addition to accelerometer(s) 417, amagnetometer and a GPS 419 (or GLONASS or other global navigationsystem) receiver for obtaining information concerning the location andorientation (e.g., portrait or landscape) of the mobile device 400.

It should be appreciated that the mobile device 400 is only one exampleof a multifunction device that may be used by users when engaging withimaging device 100, and that mobile device 400 optionally has more orfewer components than shown, optionally combines two or more components,or optionally has a different configuration or arrangement of thecomponents. The various components shown in FIG. 2 are implemented inhardware, software, firmware, or a combination thereof, including one ormore signal processing and/or application specific integrated circuits.

Memory 407 optionally includes high-speed random access memory andoptionally also includes non-volatile memory, such as one or moremagnetic disk storage devices, flash memory devices, or othernon-volatile solid-state memory devices. Access to memory 407 by othercomponents of mobile device 400, such as CPU(s) 407 is, optionally,controlled by memory controller 468.

Peripherals interface 470 can be used to couple input and outputperipherals of the mobile device 400 to CPU(s) 402 and memory 407. Theone or more processors 402 run or execute various software programsand/or sets of instructions stored in memory 407 to perform variousfunctions for mobile device 400 and to process data.

In some embodiments, peripherals interface 470, CPU(s) 402, and memorycontroller 468 are, optionally, implemented on a single chip. In someother embodiments, they are, optionally, implemented on separate chips.

The RF (radio frequency) circuitry 420 of network interface 420 receivesand sends RF signals, also called electromagnetic signals. RF circuitry420 converts electrical signals to/from electromagnetic signals andcommunicates with communications networks and other communicationsdevices via the electromagnetic signals. RF circuitry 420 optionallyincludes well-known circuitry for performing these functions, includingbut not limited to an antenna system, an RF transceiver, one or moreamplifiers, a tuner, one or more oscillators, a digital signalprocessor, a CODEC chipset, a subscriber identity module (SIM) card,memory, and so forth. RF circuitry 420 optionally communicates withnetworks 606. In some embodiments, network circuitry does not include RFcircuitry and, in fact, is connected to network 606 through one or morehard wires (e.g., an optical cable, a coaxial cable, or the like).

Examples of networks 606 include, but are not limited to, the World WideWeb (WWW), an intranet and/or a wireless network, such as a cellulartelephone network, a wireless local area network (LAN) and/or ametropolitan area network (MAN), and other devices by wirelesscommunication. The wireless communication optionally uses any of aplurality of communications standards, protocols and technologies,including but not limited to Global System for Mobile Communications(GSM), Enhanced Data GSM Environment (EDGE), high-speed downlink packetaccess (HSDPA), high-speed uplink packet access (HSDPA), Evolution,Data-Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPDA), long termevolution (LTE), near field communication (NFC), wideband code divisionmultiple access (W-CDMA), code division multiple access (CDMA), timedivision multiple access (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi)(e.g., IEEE 802.11a, IEEE 802.11ac, IEEE 802.11ax, IEEE 802.11b, IEEE802.11g and/or IEEE 802.11n), voice over Internet Protocol (VoIP),Wi-MAX, a protocol for e-mail (e.g., Internet message access protocol(IMAP) and/or post office protocol (POP)), instant messaging (e.g.,extensible messaging and presence protocol (XMPP), Session InitiationProtocol for Instant Messaging and Presence Leveraging Extensions(SIMPLE), Instant Messaging and Presence Service (IMPS)), and/or ShortMessage Service (SMS), or any other suitable communication protocol,including communication protocols not yet developed as of the filingdate of this document.

In some embodiments, audio circuitry 472, speaker 460, and microphone462 provide an audio interface between a user and device 400. The audiocircuitry 472 receives audio data from peripherals interface 470,converts the audio data to an electrical signal, and transmits theelectrical signal to speaker 460. Speaker 460 converts the electricalsignal to human-audible sound waves. Audio circuitry 472 also receiveselectrical signals converted by microphone 462 from sound waves. Audiocircuitry 472 converts the electrical signal to audio data and transmitsthe audio data to peripherals interface 470 for processing. Audio datais, optionally, retrieved from and/or transmitted to memory 407 and/orRF circuitry 420 by peripherals interface 470.

In some embodiments, power system 418 optionally includes a powermanagement system, one or more power sources (e.g., battery, alternatingcurrent (AC)), a recharging system, a power failure detection circuit, apower converter or inverter, a power status indicator (e.g., alight-emitting diode (LED)) and any other components associated with thegeneration, management and distribution of power in portable devices. Insome embodiments, such as various embodiments where the housing 300 isintegrated with the mobile device 400, battery 240, power managementcircuit 260, and communication interface 280 can be components of themobile device 400, such as Power system 418 and network interface 420.

In some embodiments, the mobile device 400 optionally also includes oneor more two-dimensional pixelated detectors 473. Two-dimensionalpixelated detector 473 optionally includes a charge-coupled device(CCD), a complementary metal-oxide-semiconductor (CMOS)phototransistors, a photo-cell, and a focal plane array. Two-dimensionalpixelated detector 473 receives light from the environment, andcommunicates with one or more lens, such as objective lens 210, andconverts the light to data representing an image. In conjunction withimaging module 431 (also called a camera module), two-dimensionalpixelated detector 473 optionally captures still images and/or video. Insome embodiments, a two-dimensional pixelated detector is located on theback of mobile device 400, opposite display system 408 on the front ofthe device, so that the touch screen is enabled for use as a viewfinderfor still and/or video image acquisition. In some embodiments, anothertwo-dimensional pixelated detector is located on the front of the mobiledevice 400. In the exemplary embodiment, the two-dimensional pixelateddetector is disposed within the housing 300.

As illustrated in FIG. 2, a device 400 preferably comprises an operatingsystem 422 that includes procedures for handling various basic systemservices. Operating system 422 (e.g., iOS, DARWIN, RTXC, LINUX, UNIX, OSX, WINDOWS, or an embedded operating system such as VxWorks) includesvarious software components and/or drivers for controlling and managinggeneral system tasks (e.g., memory management, storage device control,power management, etc.) and facilitates communication between varioushardware and software components.

In some embodiments, a device 400 further comprises an electronicaddress 620 (a mobile phone number, social media account, or e-mailaddress) associated with the corresponding user that is used in someembodiments by application 500 for communication.

In some embodiments, meta data is associated with captured multimedia,such as a device identifier (e.g., identifying the device of a group ofdevices that captured the multimedia item, which may include anarbitrary identifier, a MAC address, a device serial number, etc.),temporal meta data (e.g., date and time of a corresponding capture),location data (e.g., GPS coordinates of the location at which multimediaitem was captured), a multimedia capture frequency (e.g., the frequencyat which a stream of images is captured), device configuration settings(e.g., image resolution captured multimedia items, frequency ranges thatthe pixilated detector of a client device 104 is configured to detect),and/or other camera data or environmental factors associated withcaptured multimedia. Incorporated by reference in the present documentare U.S. Pub. No. 2017/0323472 METHODS AND SYSTEMS FOR SURFACEINFORMATICS BASED DETECTION WITH MACHINE-TO-MACHINE NETWORKS AND SMARTPHONES, U.S. application Ser. No. 15/521,871 TEMPORAL PROCESSES FORAGGREGATING MULTI DIMENSIONAL DATA FROM DISCRETE AND DISTRIBUTEDCOLLECTORS TO PROVIDE ENHANCED SPACE-TIME PERSPECTIVE, U.S. applicationSer. No. 15/522,175 METHODS AND SYSTEMS FOR REMOTE SENSING WITH DRONESAND MOUNTED SENSOR DEVICES, and U.S. application Ser. No. 15/532,578SWARM APPROACH TO CONSOLIDATING AND ENHANCING SMARTPHONE TARGET IMAGERYBY VIRTUALLY LINKING SMARTPHONE CAMERA COLLECTORS ACROSS SPACE AND TIMEUSING MACHINE-TO MACHINE NETWORKS.

In some embodiments, the device 400 further comprises an application 500including user interface 501. In some embodiments, application 500 runson native device frameworks, and is available for download onto devices400 running operating systems 422 such as Android and iOS.

FIG. 11, FIG. 12, and FIG. 13 illustrate user interface 501 inaccordance with an exemplary embodiment of the present disclosure. Insome embodiments, user interface 501 includes settings 502, gallery orstorage 504, fire or switch 290, and color pallet 506 including Spectralband selector slider 518. In some embodiments, settings 502 opens a menuor table, such as the interface shown in FIG. 12, of various options andcustomizable parameters to configured when taking ahyperspectral/multispectral image. Such options and parameters includeExposure time slider 508, ISO slider 510, notes area 512, subject modeselector 514, and remote drone control 516. In some embodiments,Exposure slider 508 allows a user to adjust the exposure time of animage from 1/3200 of a second to 30 seconds. ISO slider 510 adjusts theISO of an acquired image. In some embodiments, ISO slider can beadjusted to values in between 50 and 12,800. Notes area 512 isconfigured to allow a user or application 500 to input various text,images, videos, and the like. Mode selector 514 allows a user to adjustan acquired image according to various uses cases of the imaging device100. In the exemplary embodiment, modes for agriculture and vegetationanalysis, VEG, skin and medical analysis, SKIN, and other various usesare available for selection; however, the present discloser is notlimited there to. Drone control 516 can be utilized in variousembodiments where imaging device 100 is attached to a drone, or eachimaging device in a plurality of imaging devices is attached to arespective drone in a plurality of drones. In such embodiments, swarmcontrol and/or control of individual drone and respective devices can bemanipulated through drone control 516. Spectral band selector slider 518allows a user to manipulate spectral bands of emitted light. In thepresent embodiment, spectral band selector slider is a standard RGB256-point slider; however, in other embodiments slider 518 canincorporate other spectral bands of the electromagnetic spectrumincluding, but not limited to, infrared light and ultraviolet light. Insome embodiments, these options can be automatically adjusted andoptimized according to various environmental factors or can be manuallyadjusted by a user of the device 400.

In some embodiments, such as the embodiments shown in FIG. 1, FIG. 3,and FIG. 11, switch 290 is configured as a component of the mobiledevice 400, such as a home button. In some embodiments, switch 290 isconfigured to implement, fire, or execute a method or non-transitorycomputer readable storage medium comprising one or more programs of theimaging device 100. In some embodiments, the switch 290 is remotedactivated. The remote activation can be achieved through a sensor, aplurality of sensors, an electronic communication, or a wirelesstransmission. Thus, a user can remotely operate the imaging device 100from a distance. In some embodiments, such as the embodiment shown inFIG. 3, switch 290 a physical mechanism disposed on an external surfaceof the housing 300. In various embodiments, switch 290 can be configuredas various ON/OFF mechanism such as a knob, a dial, a slide, and thelike. In some embodiments, switch 290 is a power supply switch of theimaging device. In some embodiments, a plurality of switches 290 canexists. In some embodiments, switch 290

In some embodiments, the user interface 456 may include one or more softkeyboard embodiments. The soft keyboard embodiments may include standard(QWERTY) and/or non-standard configurations of symbols on the displayedicons.

Accordingly, a user interface according to an exemplary embodiment ofthe present disclosure achieves the advantages of allowing a user tooptimize and customize generating a hyperspectral/multispectral image.

It should be appreciated that device 400 is only one example of aportable multifunction device, and that device 400 optionally has moreor fewer components than shown in FIG. 2, optionally combines two ormore components, or optionally has a different configuration orarrangement of the components.

FIG. 3, FIG. 4, and FIG. 5 depict a front view of the imaging device 100and the housing 300 according to various embodiments of the presentdisclosure.

Referring to FIG. 3, the imaging device 100 includes an objective lens210. The objective lens 210 is disposed within the housing 300 and flushwith a surface of the housing 300. Thus, the objective lens 210 does notsubstantially extend past the given surface of the housing 300. Asillustrated in FIG. 3, a plurality of light source sets 110 is attachedor integrated into the housing 300. Each respective light source set(110-A, 110-B, 110-C) in the plurality of light source sets 110comprises a plurality of lights. Each plurality of lights is uniformlyradially distributed about the objective lens 210. In some embodiments,the plurality of light sets 110 form a circle about the objective lens210, however, the present disclosure is not limited thereto. Forinstance, in other embodiments each respective light source set (110-A,110-B, 110-C) in the plurality of light source sets 110 can form aconcentric circle about the objective lens 210. In such embodiments,there can exist k light source sets (110-A, 110-B, 110-C, 110-i, . . . ,110-k) in the plurality of light source sets forming a maximum of kconcentric circles about the objective lens 210, where k is a maximumnumber of light source sets in the plurality of light source sets 110.In various embodiments, the plurality of lights source sets can form aplurality of arc segments about the objective lens 210. The arc segmentscan be uniform; however, the present disclosure is not limited there toso long as the plurality of light source sets are uniformly distributedabout the objective lens 210.

In some embodiments, the objective lens 210 is a component of the mobiledevice 400; however, the present disclosure is not limited thereto. Forinstance, in some embodiments the objective lens 210 is a stand-alonedevice such as an auxiliary web camera. In various embodiments, theobjective lens 210 is selected from the group consisting of a 3Dbinocular, a fiber optic, a fisheye lens, a macro lens, a microscopiclens, a normal lens, and a telephoto lens.

The type of objective lens and spacing of the plurality of light sourcesets varies greatly depending on application. For instance, an imagingdevice utilized for skin care and other small region of interestapplications can have a region of interest ranging from 1 cm² to 10 cm²and a plurality of lights disposed with a diameter ranging in between0.5 cm to 10 cm. An imaging device utilized for agriculture surveyingand other large regions of interest applications care can have a regionof interest ranging from 1 m² to hundreds of thousands of m² and aplurality of lights disposed with a diameter ranging in between 0.5 cmto 10 cm. In such large region of interest applications, a user maycombine a plurality of imaging devices 100 into an array of imagingdevices. In such an embodiment, the plurality of imaging devices form aplurality of light source sets, thus accomplishing the same objectivesof a single imaging device of the present disclosure yet on a largerscale. Naturally, embodiments in between such micro and macroscopicregions of interest exist including Biometrics, materials analysis,materials detection, and the like. In some embodiments, the region ofinterest is any closed form shape (e.g., circular, elliptical, polygon,rectangular, etc.).

FIG. 6 depicts an embodiment of the present disclosure where imagingdevice 100 is integrated with mobile device 400. In some embodiments,the plurality of light source sets, and thus the imaging device, isflush with a surface of the mobile device. The term “flush”, as usedherein, is defined as a surface of a first component and a samerespective surface of a second component to have a distance or levelseparating the first component and the second component to be 0.0 cm,within a tolerance of 50 within a tolerance of 0.1 mm, within atolerance of 0.1 cm, or within a tolerance of 0.25 cm. In someembodiments, the same respective surface of the second component iscoplanar to the surface of the first component. An imaging deviceconsidered to be flush with a mobile device can be either internallydisposed within the mobile device or integrated with the mobile device.

Referring to FIG. 4, in some embodiments each light source set (110-1,110-2, 110-3, 110-4) in the plurality of light source sets 110 containsa single light source. In the present embodiment, each single lightsource has a predetermined spectral range or wavelength. As such, eachlight source set (110-1, 110-2, 110-3, 110-4) in the plurality of lightsource sets 110 emits a unique spectral range or wavelength. Thus, thelight source set 110-1 emits a first spectral range or wavelength, thelight source 110-2 emits a second spectral range or wavelength, thelight source 110-3 emits a third spectral range or wavelength, and thelight source 110-4 emits a fourth spectral range or wavelength. Forexample, the light source set 110-1 can emit red light, the light sourceset 110-2 can emit blue light, the light source set 110-3 can emit greenlight, and the light source set 110-4 can emit infrared light; however,the present invention is not limited thereto. In some embodiments, eachlight source set 110 is characterized by (e.g., emits) a predeterminedspectral range or wavelength. In some embodiments, each light source set110 is characterized by a different spectral range or wavelength thatdoes not overlap with the spectral range or wavelength of any of theother light source set 110. In some embodiments, each light source set110 is characterized by a different spectral range that does not overlapwith the spectral range of any of the other light source set 110. Insome embodiments, each light source set 110 is characterized by adifferent spectral range and the different spectral range of at leastone light source set 110 partially overlaps with the spectral range ofanother light source set 110. For instance, in some embodiments, a firstsource set 110 is characterized by a spectral range from x to y nm and asecond first source set 110 is characterized by a spectral range from wto z nm, where w is between x and y.

In various embodiments, only a red spectral band light source set, agreen light spectrum band light source set, and a blue light spectrumband light source set exists in the plurality of light source sets. Insuch embodiments, the imaging device further comprises a color detector.The color detector is configured to detect across the electromagneticspectrum, specifically the visible light band in the present embodiment,and senses excitation light reflected from a region of interest. Red,green, and blue light wavelengths bands are distinct and can easily bedifferentiated from each other, thus the detector may detect amulti-modal distribution of light. The multi-modal distribution can beanalyzed to determine the specific of wavelengths or spectral bands oflight detected by the color detector. Thus, a single image can becaptured, analyzed, and processes to produce ahyperspectral/multispectral image.

The embodiment shown in FIG. 4 depicts four light source sets (110-1,110-2, 110-3, 110-4); however, the present disclosure is not limitedthereto. In a further embodiment, the imaging device 100 includes k setsof light sources sets (110-A, 110-B, 110-i, . . . , 110-k) in theplurality of light source sets 110, where k is a positive integergreater than or equal to two. In some embodiments, the imaging device100 includes two light source sets in the plurality of light source sets110. In another embodiment, the imaging device 100 includes four lightsource sets in the plurality of light source sets 110. In yetembodiment, the imaging device 100 include five light source sets in theplurality of light source sets, six light source sets in the pluralityof light source sets, seven light source sets in the plurality of lightsource sets, eight light source sets in the plurality of light sourcesets, nine light source sets in the plurality of light source sets, tenlight source sets in the plurality of light source sets, eleven lightsource sets in the plurality of light source sets, or twelve lightsource sets in the plurality of light source sets.

In some embodiments, various light source sets in the plurality of lightsource sets may share or overlap within a spectral range.

In specific embodiments, there exists a plurality of bandpass filterssubstantially limiting the light emitted by the plurality of lightsource sets 110. Each light source in the first light source set 110-1is filtered by a different bandpass filter in a first plurality ofbandpass filters. Each bandpass filter in the first plurality ofbandpass filters limits light emission to the first spectral range.Additionally, each light source in the second light source set 110-2 isfiltered by a different bandpass filter in a section plurality ofbandpass filters. Each bandpass filter in the plurality of bandpassfilters limits light emission to the spectral range. The same holds truefor the third light source set 110-3, and the fourth light source set110-4 up to the k^(th) light source set.

In some embodiments, the plurality of bandpass filters includes at leastone longpass filter. In some embodiments, the plurality of bandpassfilters includes at least one shortpass filter.

In an exemplary embodiment of the present implementation, the pluralityof light source sets each contains a single full spectrum light source.However, a different bandpass filter is disposed over each respectivelight source set in the plurality of light source sets. The pass bandsof filters used in such implementations are based on the identity of thespectral bands to be imaged for created of the digital image.

In some embodiments, the unique spectral range of each light source setis defined by a given type of light source disposed therein. In someembodiments, the plurality of light source sets comprises full spectrumlight sources. In another embodiment, the plurality of light source setscomprises partial spectrum light sources including, but not limited to,halogen light sources, tungsten light sources, fluorescent lightsources, and/or a combination thereof. In some embodiments, theplurality of light source sets comprises stable LEDs, tunable LEDs, or acombination thereof. In some embodiments, the plurality of light sourcesets comprises 405±10 nm light sources, 475±10 nm light sources, 520±10nm light sources, 570±10 nm light sources, 630±10 nm light sources,660±10 nm light sources, 740±10 nm light sources, 890 nm±10 lightsources, or a combination thereof. In some embodiments, the plurality oflight source sets comprises 405±20 nm light sources, 475±20 nm lightsources, 520±20 nm light sources, 570±20 nm light sources, 630±20 nmlight sources, 660±20 nm light sources, 740 ±20 nm light sources, 890nm±20 light sources, or a combination thereof. In some embodiments, theplurality of light source sets comprises 405±5 nm light sources, 475±5nm light sources, 520±5 nm light sources, 570±5 nm light sources, 630±5nm light sources, 660±5 nm light sources, 740±5 nm light sources, 890nm±5 light sources, or a combination thereof In some embodiments, theplurality of light source sets comprises light sources which vary inwavelength with time or a predetermined function.

In some embodiments, the plurality of light source sets comprises alaser light source or a plurality of laser light sources. In someembodiments, a plurality of spot readings is simultaneously compiled foreach laser light source in plurality of laser light sources. Laser lightsources are particularly useful when a subject or region of interest isa solid color.

In some embodiments, the plurality of light source sets comprisesnon-polarized light sources, polarized light sources, or a combinationthereof. In some embodiments, the polarized light sources include linearpolarized sources, cross polarized sources, circular polarized sources,or a combination thereof. In some embodiments, rather than emittingpolarized light, the imaging device 100 is configured to receivedpolarized light.

In some embodiments, the first spectral range and the k^(th) spectralrange overlap but do not coexist. In other embodiments, the firstspectral range and the k^(th) spectral range overlap. In someembodiments, each spectral range in the plurality of spectral ranges isengineered for a specific predetermined wavelength or spectral range.

In some embodiments, emitted light has a radiant flux in between 5milliwatts (mW) and 95 mW. In some embodiments, emitted light has aradiant flux in between 10 mW and 75 mw. In some embodiments, emittedlight has a radiant flux in between 1 mW and 100 mW. In someembodiments, emitted light has a radiant flux in between 50 mW and 1000mW. In some embodiments, emitted light has a radiant flux in between0.01 mW and 100 mW.

In one implementation, particularly skin care uses, the imaging device100 is configured to collect a set of images, where each image iscollected at a discrete spectral band and time period, and the set ofimages comprises images collected at any two or more, any three or more,any four or more, any five or more, or all of the set of discretespectral bands having central wavelengths {475±10 nm, 520±10 nm, 570±10nm, 630±10 nm, 660±10 nm, 740±10 nm, and 890 nm±10}. In some embodimentsof this implementation, a first light source set in the plurality oflight source sets emits light which has a wavelength of 630±10 nm withan intensity of 1000 mcd for 2 ms, a second light source set in theplurality of light source sets emits light which has a wavelength of520±10 nm with an intensity of 2000 mcd for 4 ms, and a third lightsource set in the plurality of light source sets emits light which has awavelength of 405±10 nm with an intensity of 1000 mcd for 8 ms. In someembodiments of this implementation, a first light source set in theplurality of light source sets emits light which has a wavelength of630±20 nm with an intensity of 1000 mcd for 2 ms, a second light sourceset in the plurality of light source sets emits light which has awavelength of 520±20 nm with an intensity of 2000 mcd for 4 ms, and athird light source set in the plurality of light source sets emits lightwhich has a wavelength of 405±20 nm with an intensity of 1000 mcd for 8ms. In some embodiments of this implementation, a first light source setin the plurality of light source sets emits light which has a wavelengthof 630±5 nm with an intensity of 1000 mcd for 2 ms, a second lightsource set in the plurality of light source sets emits light which has awavelength of 520±5 nm with an intensity of 2000 mcd for 4 ms, and athird light source set in the plurality of light source sets emits lightwhich has a wavelength of 405±5 nm with an intensity of 1000 mcd for 8ms. The above exposure times are not meant to significantly limit thepresent disclosure. For instance, in some embodiments each exposure timecan vary by ±1 ms.

In another embodiment of the present implementation, a first lightsource set in the plurality of light source sets emits light which has awavelength of 475±10 nm with a radiant flux of 30 mW, a second lightsource set in the plurality of light source sets emits light which has awavelength of 570±10 nm with a radiant flux of 5 mW, a third lightsource set in the plurality of light source sets emits light which has awavelength of 660±10 nm with a radiant flux of 9 mW, a fourth lightsource set in the plurality of light source sets emits light which has awavelength of 740±10 nm with a radiant flux of 95 mW, and a firth lightsource set in the plurality of light source sets emits light which has awavelength of 890±10 nm with a radiant flux of 40 mW. In a furtherembodiment, each of the above wavelengths may further vary by ±5 nm or±10 nm.

In another embodiment, such as the embodiments shown in FIG. 5 and FIG.7, the plurality of light source sets 110 comprise a plurality ofclusters comprising the plurality of light source sets (110-A, 110-B,110-C, . . . , 110-k). In such an embodiment, when each light source set(110-A, 110-B, 110-C, . . . , 110-k) is fired, the entire uniform radialdistribution of lights can be illuminated. In other embodiments,unfirmly distributed regions of the imaging device can be illuminated.

Referring to FIG. 8, there can exist a plurality of light source sets(110-1, 110-2, 110-3) in the plurality of light source sets 110. Eachlight source set (110-1, 110-2, 110-3) in the plurality of light sourcesets 110 can consists of n light sources, where n is a positive integer.In the present embodiment, each light source set (110-1, 110-2, 110-3)comprises a plurality of lights (110-i-A, 110-i-B, 110-i-C, 110-i-n). Assuch, each plurality of light sources of a respective light source set(110-1, 110-2, 110-3) in the plurality of light source sets 110, isdisposed with θ₁ degrees of separation to another plurality of lightsources of the respective light source set (110-1, 110-2, 110-3) in theplurality of light source sets 110, where

$\theta_{1} = {\frac{360}{n}.}$

For example, in the present exemplary embodiment, each light source set(110-1, 110-2, 110-3) contains four plurality of light sources (e.g.,there exist four iterations of 110-1), thus 90° of separation betweeneach light source of a respective light source set.

Furthermore, in some embodiments, each plurality of lights (110-i-A,110-i-B, 110-i-C, . . . , 110-i-n) of a respective light source set(110-1, 110-2, 110-3, . . . , 110-i, 110-k) is arranged with θ₂ degreesof separation, where

${\theta_{2} = \frac{360}{kn}},$

and k is a total number of light source sets, from an adjacent pluralityof light sources of a different light source set in the plurality oflight source sets. For example, in the present embodiment, there arethree total light source sets (110-1, 110-2, 110-3) each of whichcontains four plurality of lights. Thus, each plurality of lights of therespective light source set in the plurality of light source sets isarranged with 30° of separation from an adjacent plurality of lights ofa different light source set in the plurality of light source sets.

In some embodiments, lights sources of each respective light source setin the plurality of light source sets are disposed at a same location.In such embodiments a theoretical θ₂ is zero.

The above spatial relationships ensure that a uniform light distributionpattern is emitted towards a subject while minimizing adverse luminanceand shadow effects.

In some implementations, each respective light source of a respectivelight source set (e.g., 110-1-A, 110-2-A, 110-3-A) includes a uniquediscrete spectral range or wavelength; however, the present disclosureis not limited thereto.

In some embodiments, battery 240, power management circuit 260, andcommunication interface 280 are disposed within the housing 300. In someembodiments, the battery 240 is a rechargeable battery.

In some embodiments, the communication interface 280 comprises awireless signal transmission element and instructions are sent inaccordance with a hyperspectral/multispectral imaging method by thewireless signal transmission element. In various embodiments, wirelesssignal transmission element is selected from the group consisting of aBluetooth transmission element, a ZigBee transmission element, and aWi-Fi transmission element.

In one implementation, the communication interface 280 comprises a firstcommunications interface 280. The imaging device 100 is coupled to themobile device 400, thereby bringing the first communications interface280 in direct physical and electrical communication with a secondcommunication interface of the mobile device 400, thereby enablinginstructions to be sent directly to the second communications interfacefrom the first communications interface 280 in accordance with ahyperspectral/multispectral imaging method.

As mentioned above, conventional hyperspectral/multispectral imagingdevices require high-end optics which can costs tens of thousands ofdollars per device. Accordingly, the present disclosure can be designedusing generic, off the shelf components. For example, an embodiment ofthe present disclosure can comprise a NeoPixel—12×5050 RGB LED withIntegrated Drivers, an Adafruit Pro Trinket—5 V 16 MHz controller, anAdafruit Bluefruit LE UART Friend—Bluetooth Low Energy (BLE)communication interface, an Adafruit Pro Trinket Lilon/LiPoly BackpackAdd-on power management system, and an ON-OFF Power Button/PushbuttonToggle Switch, (Adafruit Industries, New York, N.Y.). Additionally, a3.7 V 520 mAh Lithium Polymer rechargeable DV 603030 1.92 wh 14F2B BPIbattery may be purchased (Amazon.com, Inc, Seattle, Wash.). Furthermore,custom LEDs are readily available from various manufacturers, (MarktechOptoelectronics, Lathan, N.Y.).

The imaging device 100 also includes a controller 220. The controller220 comprises at least one executable program non-transiently storedtherein and is configured to control at least the plurality of lightsource sets 110. In some embodiments, the controller 220 is a componentof the mobile device 400; however, the present disclosure is not limitedthereto.

FIG. 10 collectively illustrates a flow chart of methods for imagingdiscrete wavelength bands using a device in accordance with anembodiment of the present disclosure. In the flow chart, the preferredparts of the methods are shown in solid line boxes whereas optionalvariants of the methods, or optional equipment used by the methods, areshown in dashed line boxes. As such, FIG. 10 illustrates methods forperforming a hyperspectral/multispectral regime. The methods areperformed at a device (e.g., mobile device 400) comprising one or moreprocessors, memory storing one more programs for execution by the one ormore processors, an objective lens, a two-dimensional pixelated detectorin optical communication with the objective lens, and i light sourcesets, the instructions comprising, for each integer i in the set {1, . .. , k}, wherein k is a positive integer.

As mentioned above, in various embodiments the imaging device 100 isattached to the mobile device 400. The one or more programs singularlyor collectively execute the method (1002).

In some embodiments, the objective lens is selected from the groupconsisting of a 3D binocular, a fiber optic, a fisheye lens, a macrolens, a microscopic lens, a normal lens, and a telephoto lens (1004)

In some embodiments, the two-dimensional pixelated detector is selectedfrom the group consisting of a charge-coupled device (CCD), acomplementary metal-oxide-semiconductor (CMOS), a photo-cell, and afocal plane array (1006).

In some embodiments, the mobile device is selected from the groupconsisting of a smart phone, a personal digital assistant (PDA), anenterprise digital assistant, a tablet computer, and a digital camera(1008).

In accordance with the method, the one or more programs singularly orcollectively instruct a k^(th) plurality of lights uniformly radiallydistributed about the objective lens (e.g., objective lens 210 of FIG.2) in the k^(th) light source set to fire for a k^(th) time period whilenot firing any other light source set in the plurality of light sourcesets (1010).

In some embodiments, the instructing the first light source set to fireinstructs the kth light source set to fire for no longer than 100 ms, nolonger than 8 ms, no longer than 4 ms, or no longer than 2 ms (1012).

In accordance with the method, the one or more programs singularly orcollectively instruct the two-dimensional pixelated detector to collectlight from the objective lens during all or a portion of the k^(th)predetermined time period, thereby forming at least one digital image(1014).

In some embodiments, the at least one digital image is a single digitalimage (1016).

In some embodiments, a separate image is formed at each instance of theinstructing 1010 (1018).

In some embodiments, the one or more programs singularly or collectivelycombine each separate digital image formed during the respectiveinstances of the instructing 1010 into a singlehyperspectral/multispectral image.

FIG. 14A through FIG. 14E illustrate various images and stages of imageprocessing according to an exemplary embodiment of the presentdisclosure. In the present exemplary embodiment, the imaging device ofthe present disclosure is utilized for instantaneous wrinkle detection;however, the present disclosure may also be utilized for time lapseutilizations and the like. FIG. 14A illustrates an RGB image of asubject capture by the imaging device of the present disclosure. Theimage of FIG. 14A is then processed into the images of FIG. 14B and FIG.14C, each of which comprise a discrete spectral band. Such processingcan include 16 bit TIFF. The images of FIG. 14B and FIG. 14C aresubsequently transformed to produce the image of FIG. 14D. Additionalanalysis and layer of the previous images of FIG. 14A to FIG. 14D areutilized to produce a final image of FIG. 14E. In the presentembodiment, in order to detect and differentiate wrinkles, variousparameters are considered including, but not limited to, total area perwrinkle which is a number of pixels classified as a wrinkle, percentarea as wrinkle vs total area of a given region of interest, averagelength of a feature, average width of a feature, and type classification(e.g., fine, medium, coarse). The above are conducted throughapplications of advanced remote sensing techniques, custom detectionalgorithms, and scientific calibration protocols. Such applicationsallow automated generated output on scale through an advanced workflowarchitecture incorporating advanced spatial, spectra and temporalcomponents. The images are rendered and adjustable using false colorschematics or hybrid overlay views.

FIG. 15A illustrates a lighting device 1500 according to an exemplaryembodiment of the present disclosure. The lighting device 1500 issubstantially ring-shaped and comprises a plurality of packages 1502.Each package 1502 is configured to host (e.g., for attaching, fastening)a plurality of light components such as light 110-A, light 110-B, etc.disclosed herein. In some embodiments, each package is configured suchthat it can be easily adjusted to host different light components. Forinstance, each package 1502 can host five light components 110-A, 110-B,110-C, 110-D, and 110-E as illustrated in FIG. 15A, or host five lightcomponents 110-1 a, 110-1 b-1, 110-1 b-2, 110-1 c, and 110-2 a asillustrated in FIG. 15B, where one or more of light components 110-1 a,110-1 b-1, 110-1 b-2, 110-1 c, and 110-2 a are different than lightcomponents 110-A, 110-B, 110-C, 110-D, and 110-E.

FIG. 15C and FIG. 15D illustrate a lighting device 1500 according toanother exemplary embodiment of the present disclosure. The lightingdevice 1500 comprises a plurality of packages 1502 each configured tohost (e.g., for attaching, fastening) a plurality of light componentssuch as light 110-A, light 110-B, etc. disclosed herein. Like thelighting device illustrated in FIG. 15A and FIG. 15B, in someembodiments, each package in this embodiment is configured such that itcan be easily adjusted to host different light components. For instance,each package 1502 can host five light components 110-A, 110-B, 110-C,110-D, and 110-E as illustrated in FIG. 15D, or host five lightcomponents 110-A, 110-B-1, 110-B-2, 110-B-3 and 110-B-4 as illustratedin FIG. 15E and FIG. 15F, where light components 110-B-1, 110-B-2,110-B-3 and 110-B-4 are the same as light component 110-B.

While each package in FIG. 15A to FIG. 15F is shown with five lightcomponents, it should be note that the number of light components hostedby each package is not limited to five. The number of light componentshosted by each package can be smaller than five as illustrated in FIG. 3or greater than five as illustrated in FIG. 5.

Light components can differ from each other in terms of type, shape,size, light wavelength, light intensity, or the like. In some cases, theeffectiveness of different light components (e.g., semiconductor dies)varies largely with luminous intensity differences of multiple orders ofmagnitude. Those differences can to some degree be compensated byimplementing multiple light components of the same spectral range tomatch the effectiveness of another, since lumens add up.

In some embodiments, the lighting device comprises J light source sets(i.e., each package comprises J light components) for emitting light ofK spectral ranges. J is a positive integer of three or greater, and K isa positive integer smaller than J. Each spectral range is different thanany other spectral range in the K spectral ranges. For each respectivek^(th) spectral range in the K spectral ranges, the J light source setscomprise corresponding j_(k) light source set or sets, wherein j_(k) isa positive integer of one or greater, and Σ_(k=1) ^(K)j_(k)=J. As such,at least for one specific spectral range in the K spectral ranges, thereare multiple light components in each package that emit light of thisspecific spectral range. For instance, by way of example, FIG. 15Billustrates two light components 110-1 b-1 and 110-1 b-2, within eachpackage 1502, that emit light of the same spectral range. As anotherexample, FIG. 15F illustrates four light components 10-B-1, 110-B-2,110-B-3 and 110-B-4, within each package 1502, that emit light of thesame spectral range.

In some embodiments, two or more light source sets in the J light sourcesets emit light that is substantially limited to a first spectral range,and one or more light source sets in the J light source sets emit lightthat is substantially limited to a second spectral range other than thefirst spectral range. For instance, by way of example, FIG. 15Fillustrates four light source sets (i.e., one set comprising lightcomponent 10-B-1 of each package, one set comprising light component110-B-2 of each package, one set comprising light component 110-B-3 ofeach package, and one set comprising light component 110-B-4 of eachpackage) emit light that is substantially limited to a spectral range,and one light source set (e.g., the set comprising light component 110-Aof each package) emits light that is substantially limited to anotherdifferent spectral range.

In some embodiments, one or more light source sets in the J light sourcesets emit light that is substantially limited to a third spectral rangeother than the first and second spectral ranges. For instance, by way ofexample, FIG. 15B illustrates two light source sets (i.e., one setcomprising light component 110-1 b-1 of each package and one setcomprising light component 110-1 b-2 of each package) emit light that issubstantially limited to a spectral range, one light source set (e.g.,the set comprising light component 110-1 a of each package) emits lightthat is substantially limited to another different spectral range, andone light source set (e.g., the set comprising light component 110-1 cof each package or the set comprising light component 110-2 a of eachpackage) emits light that is substantially limited to still anotherdifferent spectral range.

In some embodiments, a collective lighting intensity produced by the twoor more light source sets that emit light substantially limited to thefirst spectral range and a collective lighting intensity produced by theone or more light source sets that emit light substantially limited tothe second spectral range are substantially the same. For instance, insome embodiments, the collective lighting intensity produced by the fourlight source sets comprising light components 10-B-1, 110-B-2, 110-B-3and 110-B-4 of each package is substantially the same as the collectivelighting intensity produced by the one light source set comprising lightcomponent 110-A of each package.

In some embodiments, a collective lighting intensity produced by the twoor more light source sets that emit light substantially limited to thefirst spectral range, a collective lighting intensity produced by theone or more light source sets that emit light substantially limited tothe second spectral range, and a collective lighting intensity producedby the one or more light source sets that emit light substantiallylimited to the third spectral range are substantially the same. Forinstance, in some embodiments, the collective lighting intensityproduced by the two light source sets comprising light components 110-1b-1 and 110-1 b-2 of each package, the collective lighting intensityproduced by the one light source set comprising light component 110-1 aof each package, and the collective lighting intensity produced by theone light source set comprising light component 110-1 c or 110-2 a ofeach package are substantially the same.

In some embodiments, a collective lighting intensity produced by the twoor more light source sets that emit light substantially limited to thefirst spectral range is between 500 micro-candela to 1500 micro-candela.

In some embodiments, the light components are configured to maximize thespectral response in the desired spectral range or ranges of a region ofinterest (ROI). For instance, the specifications of the light components(e.g., spectral position and intensity) can be adjusted to maximize thespectral response in the desired spectral range or ranges. In someembodiments, the first spectral range is selected in accordance with anabsorption spectra of a first chromophore and the second spectral rangeis selected in accordance with an absorption spectra of a secondchromophore.

A light component can emit near infrared light, visible light,ultraviolet light, or other light, and the emitted light can be of anarrow spectral band or a continuous spectral range. For instance, insome embodiments, light components 110-1 a, 110-1 b and 110-1 c in FIG.15B emit near infrared light whereas light component 110-2 a emitsvisible light of a continuous spectral range. Each of light components110-1 a, 110-1 b and 110-1 c in FIG. 15B emits near infrared light of adifferent narrow spectral band.

In some embodiments, the lighting device 1500 comprise light componentsemitting light that is substantially limited to 305±10 nm, 335±10 nm,355±10 nm, 375±10 nm, 405±10 nm, 475±10 nm, 520±10 nm, 570±10 nm, 630±10nm, 660±10 nm, 740±10 nm, 890 nm±10 nm, or a combination thereof. thelighting device 1500 comprise light components emitting light that aresubstantially limited to 405±20 nm, 475±20 nm, 520±20 nm, 570±20 nm,630±20 nm, 660±20 nm, 740±20 nm, 890 nm±20 light sources, or acombination thereof. In some embodiments, the lighting device 1500comprise light components emitting light that is substantially limitedto 405±5 nm, 475±5 nm, 520±5 nm, 570±5 nm, 630±5 nm, 660±5 nm, 740±5 nm,890 nm±5 light sources, or a combination thereof. In some embodiments,the first spectral range is 305 nanometers (nm) 10 nm to 890 nm±10 nmand the second wavelength band is 305 nm±10 nm to 890 nm 10 nm.

In some embodiments, the ROI comprises a human skin or a human face. Thespectral response of human skin is mainly influenced by two majorchromophores: melanin and hemoglobin. In some embodiments, the firstspectral range is selected in accordance with an absorption spectra of afirst chromophore (e.g., one of melanin and hemoglobin) and the secondspectral range is selected in accordance with an absorption spectra of asecond chromophore (e.g., the other melanin and hemoglobin).

The lighting device 1500 can be used or integrated with the imagingdevices or mobile devices disclosed herein. In some embodiments, thelighting device 1500 is attached or integrated with the housing 300. Ina preferable embodiment, each respective light source set in the J lightsource sets comprises a plurality of lighting components that isuniformly radially distributed about the objective lens of the imagingdevice.

In some embodiments, each light source set in the J light source setsconsists of n lighting components, wherein n is a positive integer ofvalue two or greater, and each lighting component of a respective lightsource set is arranged with θ₁ degrees of separation to another lightingcomponent of the respective light source set, wherein

$\theta_{1} = {\frac{360}{n}.}$

Operation of the J light source sets and the detector of the imagingdevice can be controlled by a controller in which at least one programis non-transiently stored. The at least one program is executable by thecontroller, and when executed, causes the controller to perform themethods disclosed herein.

For instance, FIG. 16 illustrates a method 1600 performed at an imagingdevice comprising a detector, a controller, and J light source sets foremitting light of K spectral ranges, wherein J is a positive integer ofthree or greater and K is a positive integer smaller than J. Eachspectral range is different than any other spectral range in the Kspectral ranges. For each respective k^(th) spectral range in the Kspectral ranges, the J light source sets comprise corresponding j_(k)light source set or sets, wherein j_(k) is a positive integer of one orgreater, and Σ_(k=1) ^(K)j_(k)=J. At least one program isnon-transiently stored in the controller and executable by thecontroller, causing the controller to perform the method 1600.

In some embodiments, for each integer k∈{1, . . . , K}, the method 1600comprises: (A) concurrently firing lighting components of the j_(k)light source set or sets in the J light source sets for a k^(th)predetermined time period (Block 1602); and (B) collecting, using thedetector, light during all or a portion of the k^(th) predetermined timeperiod, thereby forming at least one digital image (Block 1604).

For instance, in some embodiments, two or more light source sets in theJ light source sets emit light that is substantially limited to a firstspectral range, and one or more light source sets in the J light sourcesets emit light that is substantially limited to a second spectral rangeother than the first spectral range. In such embodiments, the method1600 comprises: (i) concurrently firing the two or more light sourcesets that emit light substantially limited to the first spectral rangewhile not firing any other light source set in the J light source sets;(ii) collecting light from the objective lens over a first time periodusing the detector; (iii) concurrently firing the one or more lightsource sets that emit light substantially limited to the second spectralrange while not firing any other light source set in the J light sourcesets; and (iv) collecting light from the objective lens over a secondtime period using the detector, thereby forming at least one digitalimage. In some embodiments, one or more light source sets in the J lightsource sets emit light that is substantially limited to a third spectralrange other than the first and second spectral ranges. In suchembodiments, the method 1600 further comprises: (v) concurrently firingthe one or more light source sets that emit light substantially limitedto the third spectral range while not firing any other light source setin the J light source sets; and (vi) collecting light from the objectivelens over a third time period using the detector.

FIG. 17A, FIG. 17B and FIG. 17C collectively illustrate a flow chart ofan exemplary method 1700 for reducing or eliminating ambient lighteffect. The method 1700 can be performed at an imaging device includingbut not limited to devices disclosed here. For instance, in someembodiments, the method 1700 is performed at an imaging devicecomprising one or more light source sets, a detector and a controller.At least one program is non-transiently stored in the controller andexecutable by the controller. When executed, the at least one programcauses the controller to perform the method 1700.

To reduce or eliminate the effect of ambient light, the method 1700implements a subtraction procedure that acquires two images of the ROI,one with illumination light and one with only ambient light, and thensubtracts the image with only ambient light from the image withillumination light. In a preferable embodiment, the illumination lighthas an intensity greater the that of the ambient light. In someembodiments, for instance when there are spatial offsets between the twoimages, the method 1700 also performs one or more automated registrationprocedures to correct the spatial offsets.

In some embodiments, the method 1700 comprises: (A) acquiring areference image of a region of interest (ROI) by using the detector tocollect light over a reference time period while the ROI is not exposedto any light emitted from the one or more light source sets, wherein thereference image comprises an array of pixels each corresponding to asub-region in an array of sub-regions of the ROI (Block 1702). That theROI not exposed to any light emitted from the one or more light sourcesets can be achieved, by not firing any of the one or more light sourcesets, by blocking the pathway of the light from the one or more lightsource sets to the ROI, or the like.

The method 1700 comprises: (B) firing a first light source set while notfiring any other light source set in the one or more light source sets,wherein the first light source set in the one or more light source setsemits light that is substantially limited to a first spectral range(Block 1704). In a preferable embodiment, the light emitted from eachlight source set in the one or more light source sets has an intensityhigher than the light from the ambient. In some embodiments, the firsttime period is substantially the same as the reference time period. Insome embodiments, for instance when the imaging device further comprisesan objective lens in optical communication with the detector, the firstlight source set in the one or more light source sets comprises aplurality of lighting components that is radially distributed about theobjective lens of the imaging device.

The method 1700 also comprises (C) acquiring a first target image of theROI by using the detector to collect light over a first time periodwhile the ROI is exposed to the light emitted from the first lightsource set, wherein the first target image comprises an array of pixelseach corresponding to a sub-region in the array of sub-regions of theROI (Block 1706). In some embodiments, the detector comprises atwo-dimensional pixelated detector such as the two-dimensional pixelateddetector 473 disclosed herein.

The method 1700 further comprises: (D) compensating the first targetimage of the ROI using the reference image of the ROI, therebygenerating a first compensated image of the ROI, wherein each respectivepixel in the array of pixels of the first target image is compensatedusing the corresponding pixel in the array of pixels of the referenceimage (Block 1710). In some embodiments, each respective pixel in thearray of pixels of the first target image is compensated by subtracting,from an intensity value at the respective pixel, an intensity value atthe corresponding pixel in the array of pixels of the reference imagemultiplied by a ratio of the first time period over the reference timeperiod.

The method 1700 can implement alternative, additional or optionalprocedures. For instance, in some embodiments (e.g., when there arespatial offsets between the reference image and the first target image),prior to the compensating (D), the method 1700 performs a step of: (E)co-registering the reference image and the first target image of the ROI(Block 1708).

In some embodiments, the method 1700 performs reduction or eliminationof ambient light effect for images acquired at one or more otherspectral ranges. For instance, in some embodiments, the method 1700performs the steps of: (F) firing a second light source set while notfiring any other light source set in the one or more light source sets,wherein the second light source set in the one or more light source setsemits light that is substantially limited to a second spectral range,and the second spectral range that is different than the first spectralrange (Block 1712); (G) acquiring a second target image of the ROI byusing the detector to collect light over a second time period while theROI is exposed to the light emitted from the second light source set,wherein the second target image comprises an array of pixels eachcorresponding to a sub-region in the array of sub-regions of the ROI(Block 1714); and (H) compensating the second target image of the ROIusing the reference image of the ROI, thereby generating a secondcompensated image of the ROI, wherein each respective pixel in the arrayof pixels of the second target image is compensated using thecorresponding pixel in the array of pixels of the reference image (Block1716). In some embodiments, each respective pixel in the array of pixelsof the second target image is compensated by subtracting, from anintensity value at the respective pixel, an intensity value at thecorresponding pixel in the array of pixels of the reference imagemultiplied by a ratio of the second time period over the reference timeperiod. In some embodiments, the second time period is substantially thesame as the first time period and/or the reference time period.

FIG. 18A and FIG. 18B collectively illustrate a flow chart of anotherexemplary method 1800 for reducing or eliminating the effect of ambientlight. The method 1800 can be performed at an imaging device includingbut not limited to devices disclosed here. For instance, in someembodiments, the method 1800 is performed at an image device comprisinga detector, a controller, and J light source sets for emitting light ofK spectral ranges, wherein each spectral range is different than anyother spectral range in the K spectral ranges. J and K are positiveintegrals. For each respective k^(th) spectral range in the K spectralranges, the J light source sets comprise corresponding j_(k) lightsource set or sets, wherein j_(k) is a positive integer of one orgreater, and Σ_(k=1) ^(K)j_(k)=J. In some embodiments, K equals to J.That is, for each respective k^(th) spectral range in the K spectralranges, there is one single corresponding light source set in the Jlight source sets. In some embodiments, J is a positive integer of threeor greater and K is a positive integer smaller than J. That is, for atleast one spectral range in the K spectral ranges, there are multiplecorresponding light source sets in the J light source sets. Forinstance, in some embodiments, two or more light source sets in the Jlight source sets emit light that is substantially limited to a firstspectral range, and one or more light source sets in the J light sourcesets emit light that is substantially limited to a second spectral rangeother than the first spectral range. In some embodiments, one or morelight source sets in the J light source sets emit light that issubstantially limited to a third spectral range other than the first andsecond spectral ranges.

At least one program is non-transiently stored in the controller andexecutable by the controller. When executed, the at least one programcauses the controller to perform the method 1800 comprising: (A)acquiring a reference image of a region of interest (ROI) by using thedetector to collect light over a reference time period while the ROI isnot exposed to any light emitted from the one or more light source sets,wherein the reference image comprises an array of pixels eachcorresponding to a sub-region in an array of sub-regions of the ROI(Block 1802). For each integer k∈{1, . . . , K}, the method 1800 alsoincludes: (B) concurrently firing lighting components of the j_(k) lightsource set or sets in the J light source sets while not firing any otherlight source set in the J light source sets (Block 1804); (C) acquiringa respectively target image of the ROI by using the detector to collectlight over a respective k^(th) target time period while the ROI isexposed to the light emitted from the j_(k) light source set or sets,wherein the respective target image comprises an array of pixels eachcorresponding to a sub-region in the array of sub-regions of the ROI(Block 1806); and (D) compensating the respective target image of theROI using the reference image of the ROI, thereby generating arespective compensated image of the ROI, wherein each respective pixelin the array of pixels of the respective target image is compensatedusing the corresponding pixel in the array of pixels of the referenceimage (Block 1810). In some embodiments, each respective pixel in thearray of pixels of the respective target image is compensated bysubtracting, from an intensity value at the respective pixel, anintensity value at the corresponding pixel in the array of pixels of thereference image multiplied by a ratio of the respective k^(th) targettime period over the reference time period.

The method 1800 can implement alternative, additional or optionalprocedures. For instance, similar to the method 1700, in someembodiments (e.g., when there are spatial offsets between the referenceimage and the first target image), prior to the compensating (D), themethod 1800 performs a step of: (E) co-registering the reference imageand the respective target image of the ROI (Block 1808). In someembodiments, the method 1800 further comprises: (F) combining eachrespective compensated image of the ROI generated using each respectivelight source set in the plurality of light source sets into a singlehyperspectral/multispectral image (Block 1812).

FIG. 19A, FIG. 19B and FIG. 19C collectively illustrate a flow chart ofan exemplary method 1800 for reducing or eliminating incidence angle anddistance effect. The method 1900 can be performed at an imaging deviceincluding but not limited to devices disclosed here. For instance, insome embodiments, the method 1900 is performed at an imaging devicecomprising an objective lens, a light source adjacent to the objectivelens, a detector in optical communication with the objective lens, and acontroller. At least one program is non-transiently stored in thecontroller and executable by the controller. When executed, the at leastone program causes the controller to perform the method 1900.

Preferably, the light source is any substantially ring-shaped lightsources or lighting devices disclosed herein. Since the light source isadjacent or surrounding the objective lens, the angle of projection issimilar to the angle of a camera. As such, the method 1900 implements anormalization procedure to reduce or eliminate the brightnessdifferences due to the incidence angle effect within an image. In someembodiments, the image data is normalized against data collected from aLambertian surface at a selfie-like distance (e.g., between 0.5 to 2feet).

To reduce or illuminate the distance effect, the method 1900 firstimplements 3D reconstruction procedures to create a 3D model. 3Dreconstruction can be made from multiple images or from a single image.For instance, Jackson et al. 2017 discloses 3D reconstruction from asingle image, entitled “Large Pose 3D Face Reconstruction from a SingleImage via Direct Volumetric CNN Regression”, which is herebyincorporated by reference in their entirety. The method 1900 then usesthe 3D model to identify the depths of the scene, e.g., parts(sub-regions of the ROI) closer and further away with respect to theobjective lens or a reference plane. Since parts are illuminateddifferently depending on the distance from the camera/light-sourcesetup, parts that are further away appear less bright than parts thatare closer to the objective lens. Those parts can then be linearlycorrected in brightness, for instance, the pixel brightness levels canbe adjusted to or based on the intensities of a pseudo flat surface.

In some embodiments, the method 1900 comprises: (A) acquiring a targetimage of a region of interest (ROI) by using the detector to collectlight over a target time period while the ROI is exposed to lightemitted from the light source, wherein the target image comprises anarray of pixels each corresponding to a sub-region in an array ofsub-regions of the ROI (Block 1902). In some embodiments, the ROI is aface of a subject. In an embodiment, the ROI is a full face of asubject.

In a preferable embodiment, the light source comprises one or more lightsource sets, each light source set comprising a plurality of lightingcomponents that is radially distributed about the objective lens. Insome embodiments, the light source comprises J light source sets foremitting light of K spectral ranges, wherein each spectral range isdifferent than any other spectral range in the K spectral ranges. Foreach respective k^(th) spectral range in the K spectral ranges, the Jlight source sets comprise corresponding j_(k) light source set or sets,wherein j_(k) is a positive integer of one or greater, and Σ_(k=1)^(K)j_(k)=J. Each light source set in the J light source sets comprisesa plurality of lighting components that is radially distributed aboutthe objective lens. In an embodiment, J is a positive integer of threeor greater and K is a positive integer smaller than J.

The method 1900 also comprises: creating a three-dimensional model forthe ROI using the target image of the ROI, wherein the three-dimensionalmodel comprises a plurality of points, each comprising three spatialcoordinates (Block 1908). In some embodiments, the three-dimensionalmodel for the ROI is created using a volumetric Convolutional NeuralNetwork (CNN) that performs direction regression of a volumetricrepresentation of the three-dimensional model from the target image.

The method 1900 further comprises: (C) determining a relative distanceof each respective point in the plurality of points of thethree-dimensional model with respect to the objective lens or withrespect to a pseudo flat surface (Block 1910); and (D) adjustingbrightness levels of the three-dimensional model in accordance with thedetermined relative distance of each respective point in the pluralityof points of the three-dimensional model (Block 1912). In someembodiments, the brightness levels of the three-dimensional model areadjusted linearly in accordance with the relative distances. In anembodiment, the brightness levels of the three-dimensional model areadjusted based on intensity values at the pseudo flat surface. Inanother embodiment, the brightness levels of the three-dimensional modelare adjusted to brightness values at the pseudo flat surface.

The method 1900 can implement alternative, additional or optionalprocedures. For instance, the method 1900 can implement the proceduresto reduce or eliminate the ambient light effect. To do so, the method1900 comprises: (E) compensating, prior to the creating (B), the targetimage of the ROI using a reference image of the ROI, thereby generatinga compensated image of the ROI, wherein the reference image of the ROIis acquired by using the detector to collect light over a reference timeperiod while the ROI is not exposed to any light emitted from the lightsource, wherein each respective pixel in an array of pixels of thetarget image is compensated using the corresponding pixel in an array ofpixels of the reference image, and wherein the creating (B) is performedon the compensated target image (Block 1904).

In some embodiments, prior to the creating (B) of the 3D model, themethod 1900 implements procedures to correct incidence angle effect. Forinstance, in some embodiments, the method 1900 further comprises: (F)normalizing, prior to the creating (B), the target image of the ROIusing a dataset collected from a Lambertian surface, thereby producing anormalized target image, wherein an intensity value of each respectivepixel in the array of pixels of the target image is normalized by acorresponding intensity value in the dataset of the Lambertian surface,and wherein the creating (B) is performed on the normalized target image(Block 1906). In an embodiment, the dataset of the Lambertian surface iscollected with the Lambertian surface positioned at a distance ofbetween 0.5 feet and 3 feet from the objective lens.

In some embodiments, the normalizing (F) is performed, subsequent thecompensating (E), on the compensated target image.

Additional Exemplary Embodiments

Implementation 1: In some embodiments, the present disclosure provides acomputer-implemented method of correcting a target image at a centralcontrolling system. The method comprises: (A) using one or morecomputer-enabled imaging devices to collect image data of a region ofinterest by causing the one or more computer-enabled imaging devices toexecute a method comprising: (i) obtaining a reference image of a regionof interest in accordance with a first plurality of capture parametersat a first time using the one or more computer-enabled imaging devices,wherein the first plurality of capture parameters comprises a firstsubset of capture parameters, and a second subset of capture parametersdifferent than the first subset of capture parameters; (ii) obtainingthe target image of the region of interest in accordance with a secondplurality of capture parameters at a second time using the one or morecomputer-enabled imaging devices, wherein the second plurality ofcapture parameters comprises the first subset of capture parameters, anda third subset of capture parameters different than both of the firstsubset of capture parameters and the second subset of captureparameters; and (iii) communicating to the central computer-system thereference image with the first plurality of capture parameters and thetarget image with the second plurality of capture parameters; and (B) atthe central controlling system, the central controlling system havingone or more processors and memory for storing one or more programs forexecution by the one or more processors, executing the method of: (i)receiving the reference image with the first plurality of captureparameters and the target image with the second plurality of captureparameters from the one or more computer-enabled imaging devices; and(ii) using the first subset of capture parameters, the second subset ofcapture parameters, and the third subset of capture parameters tocorrect the target image against the reference image, thereby forming acorrected target image.

Implementation 2: In some embodiments, the computer-implemented methodof Implementation 1, wherein an elapsed period of time between the firsttime of the obtaining the first image and the second time of theobtaining the second image is less than one second.

Implementation 3: In some embodiments, the computer-implemented methodof Implementation 1, wherein the second subset of capture parameterscomprise a first wavelength spectra of light at a first intensity, andthe third subset of capture parameters comprise a second wavelengthspectra of light at a second intensity.

Implementation 4: In some embodiments, the computer-implemented methodof Implementation 3, wherein the using the capture parameters at thecentral controlling system comprises: evaluating the reference image todetermine the first wavelength spectra, and determining the secondwavelength spectra based on a difference between a predeterminedwavelength spectra of the third subset of control parameters of thetarget image and the first wavelength spectra of the reference image.

Implementation 5: In some embodiments, the computer-implemented methodof Implementation 3, wherein the second wavelength spectra comprises apredetermined wavelength spectra and the first wavelength spectra.

Implementation 6: In some embodiments, the computer-implemented methodof Implementation 3, wherein the second intensity of light is greaterthan the first intensity of light.

Implementation 7: In some embodiments, the computer-implemented methodof Implementation 3, wherein the using the capture parameters at thecentral controlling system comprises: evaluating a difference betweenthe first wavelength spectra and the second wavelength spectra, andremoving the difference between the first wavelength spectra and thesecond wavelength spectra from the target image, thereby forming thecorrected target image.

Implementation 8: In some embodiments, the computer-implemented methodof Implementation 1, wherein the first subset of capture parameterscomprises a distance from the one or more computer-enabled imagingdevices to the target of region and a tolerance of variation from thedistance, and the using the capture parameters at the centralcontrolling system comprises: evaluating a difference between a firsttolerance of variation from the distance for the reference image and asecond tolerance of variation from the distance for the target image,and offsetting the target image by the difference between the firsttolerance and the second tolerance, thereby forming the corrected targetimage.

Implementation 9: In some embodiments, the computer-implemented methodof Implementation 1, wherein the obtaining the reference image comprisesforming a three-dimensional model of a portion of the region ofinterest, and

Implementation 10: In some embodiments, the computer-implemented methodof Implementation 9, wherein the region of interest comprises a texturedsurface, and the using the capture parameters at the central controllingsystem comprises: evaluating the reference image for one or morevariations in luminance caused by the textured surface, forming adigital map of the textured surface based on the evaluation of one ormore variations in luminance, and applying the digital map of thetextured surface to the target image, thereby forming the correctedtarget image.

Implementation 11: In some embodiments, the computer-implemented methodof Implementation 10, wherein the digital map is a map of reflectiveproperties of the textured surface.

Implementation 12: In some embodiments, the computer-implemented methodof Implementation 10, wherein the applying the digital map corrects aluminance of the target image to form the corrected target image.

Implementation 13: In some embodiments, the computer-implemented methodof Implementation 10, wherein: the evaluating the reference image forone or more variations in luminance forms an evaluation of a change inheight of the textured surface, and the digital map is a map of theevaluated change in height of the textured surface.

Implementation 14: In some embodiments, the computer-implemented methodof Implementation 10, wherein the digital map is a flattened replicationof the textured surface, and the applying the digital map flattens thetextured surface of the region of interest in the target image to formthe corrected target image.

Implementation 15: In some embodiments, the computer-implemented methodof Implementation 10, wherein the applying the digital map of thetextured surface to the target image corrects a luminance of the targetimage based on a linear function, thereby forming the corrected targetimage.

Imaging devices of the present discloser enable a user to acquire ahyperspectral/multispectral image of a wide range of regions ofinterest, from small scale images such as pores on a person's face tolarge scale images such as farms and geological formations. Anotheradvantage of the present invention is ability to increase the energy ofa system by providing high illuminance in order to generate a highquality hyperspectral/multispectral image. Furthermore, the presentdisclosure can be provided at a reduced manufacturing costs.

For convenience in explanation and accurate definition in the appendedclaims, the terms “upper”, “lower”, “up”, “down”, “upwards”,“downwards”, “inner”, “outer”, “inside”, “outside”, “inwardly”,“outwardly”, “interior”, “exterior”, “front”, “rear”, “back”,“forwards”, and “backwards” are used to describe features of theexemplary embodiments with reference to the positions of such featuresas displayed in the figures.

The foregoing descriptions of specific exemplary embodiments of thepresent invention have been presented for purposes of illustration anddescription. They are not intended to be exhaustive or to limit theinvention to the precise forms disclosed, and obviously manymodifications and variations are possible in light of the aboveteachings. The exemplary embodiments were chosen and described in orderto explain certain principles of the invention and their practicalapplication, to thereby enable others skilled in the art to make andutilize various exemplary embodiments of the present invention, as wellas various alternatives and modifications thereof. It is intended thatthe scope of the invention be defined by the Claims appended hereto andtheir equivalents.

1-26. (canceled)
 27. A method comprising: at an imaging devicecomprising one or more light source sets, a detector and a controller,wherein at least one program is non-transiently stored in the controllerand executable by the controller, the at least one program causing thecontroller to perform the method of: (A) acquiring a reference image ofa region of interest (ROI) by using the detector to collect light over areference time period while the ROI is not exposed to any light emittedfrom the one or more light source sets, wherein the reference imagecomprises an array of pixels each corresponding to a sub-region in anarray of sub-regions of the ROI; (B) firing a first light source setwhile not firing any other light source set in the one or more lightsource sets, wherein the first light source set in the one or more lightsource sets emits light that is substantially limited to a firstspectral range; (C) acquiring a first target image of the ROI by usingthe detector to collect light over a first time period while the ROI isexposed to the light emitted from the first light source set, whereinthe first target image comprises an array of pixels each correspondingto a sub-region in the array of sub-regions of the ROI; and (D)compensating the first target image of the ROI using the reference imageof the ROI, thereby generating a first compensated image of the ROI,wherein each respective pixel in the array of pixels of the first targetimage is compensated using the corresponding pixel in the array ofpixels of the reference image.
 28. The method of claim 27, wherein eachrespective pixel in the array of pixels of the first target image iscompensated by subtracting, from an intensity value at the respectivepixel, an intensity value at the corresponding pixel in the array ofpixels of the reference image multiplied by a ratio of the first timeperiod over the reference time period.
 29. The method of claim 27,wherein the first time period is substantially the same as the referencetime period.
 30. The method of claim 27, wherein the first time periodis between 1 millisecond and 100 milliseconds.
 31. The method of claim27, wherein the detector comprises a two-dimensional pixelated detector.32. The method of claim 27, wherein the imaging device further comprisesan objective lens in optical communication with the detector, whereinthe first light source set in the one or more light source setscomprises a plurality of lighting components that is radiallydistributed about the objective lens.
 33. The method of claim 27,wherein the light emitted from each light source set in the one or morelight source sets has an intensity higher than the light from anambient.
 34. The method of claim 27, further comprising: (E)co-registering, prior to the compensating (D), the reference image andthe first target image of the ROI.
 35. The method of claim 27, furthercomprising: (F) firing a second light source set while not firing anyother light source set in the one or more light source sets, wherein thesecond light source set in the one or more light source sets emits lightthat is substantially limited to a second spectral range, and the secondspectral range that is different than the first spectral range; (G)acquiring a second target image of the ROI by using the detector tocollect light over a second time period while the ROI is exposed to thelight emitted from the second light source set, wherein the secondtarget image comprises an array of pixels each corresponding to asub-region in the array of sub-regions of the ROI; and (H) compensatingthe second target image of the ROI using the reference image of the ROI,thereby generating a second compensated image of the ROI, wherein eachrespective pixel in the array of pixels of the second target image iscompensated using the corresponding pixel in the array of pixels of thereference image.
 36. The method of claim 35, wherein each respectivepixel in the array of pixels of the second target image is compensatedby subtracting, from an intensity value at the respective pixel, anintensity value at the corresponding pixel in the array of pixels of thereference image multiplied by a ratio of the second time period over thereference time period.
 37. The method of claim 35, wherein the secondtime period is substantially the same as the first time period and/orthe reference time period.
 38. A method comprising: at an image devicecomprising a detector, a controller, and J light source sets foremitting light of K spectral ranges, wherein each spectral range isdifferent than any other spectral range in the K spectral ranges,wherein for each respective k^(th) spectral range in the K spectralranges, the J light source sets comprise corresponding j_(k) lightsource set or sets, wherein j_(k) is a positive integer of one orgreater, and Σ_(k=1) ^(K)j_(k)=J, and wherein at least one program isnon-transiently stored in the controller and executable by thecontroller, the at least one program causing the controller to performthe method of: (A) acquiring a reference image of a region of interest(ROI) by using the detector to collect light over a reference timeperiod while the ROI is not exposed to any light emitted from the one ormore light source sets, wherein the reference image comprises an arrayof pixels each corresponding to a sub-region in an array of sub-regionsof the ROI; and for each integer k∈{1, . . . , K}: (B) concurrentlyfiring lighting components of the j_(k) light source set or sets in theJ light source sets while not firing any other light source set in the Jlight source sets; (C) acquiring a respectively target image of the ROIby using the detector to collect light over a respective k^(th) targettime period while the ROI is exposed to the light emitted from the j_(k)light source set or sets, wherein the respective target image comprisesan array of pixels each corresponding to a sub-region in the array ofsub-regions of the ROI; and (D) compensating the respective target imageof the ROI using the reference image of the ROI, thereby generating arespective compensated image of the ROI, wherein each respective pixelin the array of pixels of the respective target image is compensatedusing the corresponding pixel in the array of pixels of the referenceimage.
 39. The method of claim 38, wherein each respective pixel in thearray of pixels of the respective target image is compensated bysubtracting, from an intensity value at the respective pixel, anintensity value at the corresponding pixel in the array of pixels of thereference image multiplied by a ratio of the respective k^(th) targettime period over the reference time period.
 40. The method of claim 38,further comprising: (E) co-registering, prior to the compensating (D),the reference image and the respective target image of the ROI.
 41. Themethod of claim 38, further comprising: (F) combining each respectivecompensated image of the ROI generated using each respective lightsource set in the plurality of light source sets into a singlehyperspectral/multispectral image.
 42. The method of claim 38, wherein Jis a positive integer of three or greater and K is a positive integersmaller than J.
 43. The method of claim 42, wherein: two or more lightsource sets in the J light source sets emit light that is substantiallylimited to a first spectral range, and one or more light source sets inthe J light source sets emit light that is substantially limited to asecond spectral range other than the first spectral range.
 44. Themethod of claim 43, wherein: one or more light source sets in the Jlight source sets emit light that is substantially limited to a thirdspectral range other than the first and second spectral ranges. 45-60.(canceled)
 61. A non-transitory computer readable storage mediumcomprising instructions for use at an imaging device, wherein theimaging device comprises one or more light source sets, a detector and acontroller, and the instructions are non-transiently stored in thecontroller and executable by the controller, the instructions causingthe controller to perform a method of: (A) acquiring a reference imageof a region of interest (ROI) by using the detector to collect lightover a reference time period while the ROI is not exposed to any lightemitted from the one or more light source sets, wherein the referenceimage comprises an array of pixels each corresponding to a sub-region inan array of sub-regions of the ROI; (B) firing a first light source setwhile not firing any other light source set in the one or more lightsource sets, wherein the first light source set in the one or more lightsource sets emits light that is substantially limited to a firstspectral range; (C) acquiring a first target image of the ROI by usingthe detector to collect light over a first time period while the ROI isexposed to the light emitted from the first light source set, whereinthe first target image comprises an array of pixels each correspondingto a sub-region in the array of sub-regions of the ROI; and (D)compensating the first target image of the ROI using the reference imageof the ROI, thereby generating a first compensated image of the ROI,wherein each respective pixel in the array of pixels of the first targetimage is compensated using the corresponding pixel in the array ofpixels of the reference image. 62-71. (canceled)
 72. A non-transitorycomputer readable storage medium comprising instructions for use at animaging device, wherein the imaging device comprises a detector, acontroller, and J light source sets for emitting light of K spectralranges, wherein each spectral range is different than any other spectralrange in the K spectral ranges, wherein for each respective k^(th)spectral range in the K spectral ranges, the J light source setscomprise corresponding j_(k) light source set or sets, wherein j_(k) isa positive integer of one or greater, and Σ_(k=1) ^(K)j_(k)=J, and theinstructions are non-transiently stored in the controller and executableby the controller, the instructions causing the controller to perform amethod of: (A) acquiring a reference image of a region of interest (ROI)by using the detector to collect light over a reference time periodwhile the ROI is not exposed to any light emitted from the one or morelight source sets, wherein the reference image comprises an array ofpixels each corresponding to a sub-region in an array of sub-regions ofthe ROI; and for each integer k∈{1, . . . , K}: (B) concurrently firinglighting components of the j_(k) light source set or sets in the J lightsource sets while not firing any other light source set in the J lightsource sets; (C) acquiring a respectively target image of the ROI byusing the detector to collect light over a respective k^(th) target timeperiod while the ROI is exposed to the light emitted from the j_(k)light source set or sets, wherein the respective target image comprisesan array of pixels each corresponding to a sub-region in the array ofsub-regions of the ROI; and (D) compensating the respective target imageof the ROI using the reference image of the ROI, thereby generating arespective compensated image of the ROI, wherein each respective pixelin the array of pixels of the respective target image is compensatedusing the corresponding pixel in the array of pixels of the referenceimage. 73-91. (canceled)